hadoop Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.a

admin

[admin@hadoop-1 hadoop-3.2.2]$ hadoop jar /data/module/hadoop-3.2.2/share/hadoop/mapreduce/hadoop-mapreduce-examples-3.2.2.jar pi 10 100
Number of Maps  = 10
Samples per Map = 100
Wrote input for Map #0
Wrote input for Map #1
Wrote input for Map #2
6 G. s. {3 K$ b2 w- m) oWrote input for Map #3
Wrote input for Map #4
Wrote input for Map #5
Wrote input for Map #6
. u; _, I' I: E  j) R* rWrote input for Map #7
! L: \- q: B9 w7 O* `8 k' ~% g' hWrote input for Map #8
Wrote input for Map #9
Starting Job
/ O9 \( v3 m$ K8 h4 y" Z! g: f2022-11-16 15:32:34,946 INFO client.ConfiguredRMFailoverProxyProvider: Failing over to rm2
# b! X0 [/ R2 `. u+ R4 A( C2022-11-16 15:32:35,174 INFO mapreduce.JobResourceUploader: Disabling Erasure Coding for path: /tmp/hadoop-yarn/staging/admin/.staging/job_1668583281306_0001
2022-11-16 15:32:35,389 INFO input.FileInputFormat: Total input files to process : 10
9 u. {  @. F2 r8 [0 G& d4 [  N9 _2022-11-16 15:32:35,592 INFO mapreduce.JobSubmitter: number of splits:10
& L1 L& [4 z4 U* V+ k2022-11-16 15:32:35,806 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1668583281306_0001
2022-11-16 15:32:35,808 INFO mapreduce.JobSubmitter: Executing with tokens: []
2022-11-16 15:32:36,044 INFO conf.Configuration: resource-types.xml not found
( J% i" ^" g! ]; j2022-11-16 15:32:36,044 INFO resource.ResourceUtils: Unable to find 'resource-types.xml'.
2022-11-16 15:32:36,423 INFO impl.YarnClientImpl: Submitted application application_1668583281306_0001
2022-11-16 15:32:36,504 INFO mapreduce.Job: The url to track the job: http://hadoop-2:8088/proxy/application_1668583281306_0001/
2022-11-16 15:32:36,505 INFO mapreduce.Job: Running job: job_1668583281306_0001
2022-11-16 15:32:41,561 INFO mapreduce.Job: Job job_1668583281306_0001 running in uber mode : false
2022-11-16 15:32:41,563 INFO mapreduce.Job:  map 0% reduce 0%
2022-11-16 15:32:41,583 INFO mapreduce.Job: Job job_1668583281306_0001 failed with state FAILED due to: Application application_1668583281306_0001 failed 2 times due to AM Container for appattempt_1668583281306_0001_000002 exited with  exitCode: 1
Failing this attempt.Diagnostics: [2022-11-16 15:32:40.765]Exception from container-launch.
; ]3 L( ?- \' w# [/ u0 Q) y: RContainer id: container_1668583281306_0001_02_000001
; l, \* e& z, e- l) G  I/ C% iExit code: 1
) z1 i. j1 K) m4 D6 I7 O
8 T' X# ]* z$ r% q' |% ?/ j: v[2022-11-16 15:32:40.799]Container exited with a non-zero exit code 1. Error file: prelaunch.err.
Last 4096 bytes of prelaunch.err :
6 s- S* e% |5 ~2 @+ |Last 4096 bytes of stderr :
% C# g) o5 d: u( D1 T8 VError: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster

Please check whether your etc/hadoop/mapred-site.xml contains the below configuration:
<property>
+ R$ Z7 F' T. w* o; D0 O, M  <name>yarn.app.mapreduce.am.env</name>
3 i, r- L. \4 M2 H  <value>HADOOP_MAPRED_HOME=${full path of your hadoop distribution directory}</value>
</property>
/ B  B6 O& {' L( k<property>
  <name>mapreduce.map.env</name>
3 U) b. ]* O9 ^& i- ^8 U  <value>HADOOP_MAPRED_HOME=${full path of your hadoop distribution directory}</value>
/ J9 F+ T; R- D6 \</property>
6 i& p; p/ P8 o4 c' g: R& }<property>
  <name>mapreduce.reduce.env</name>
  <value>HADOOP_MAPRED_HOME=${full path of your hadoop distribution directory}</value>
, z: y6 c" x1 e</property>

% q+ V% N- {& B! H0 Z3 E8 v% H[2022-11-16 15:32:40.800]Container exited with a non-zero exit code 1. Error file: prelaunch.err.
Last 4096 bytes of prelaunch.err :
: E! G9 U7 u& d% @Last 4096 bytes of stderr :
$ t1 Z& ?5 x7 v$ g" BError: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster

5 J% b' W% I  q# d! P8 YPlease check whether your etc/hadoop/mapred-site.xml contains the below configuration:
<property>
$ ?$ |. p1 j$ G  <name>yarn.app.mapreduce.am.env</name>
" R$ |, F5 ^3 C5 E  H# T  <value>HADOOP_MAPRED_HOME=${full path of your hadoop distribution directory}</value>
" T8 q8 j) b* E% p+ e& t, y</property>
<property>
  <name>mapreduce.map.env</name>
4 [% f. X( c8 a; u# N6 E) j1 X/ k1 r: X  <value>HADOOP_MAPRED_HOME=${full path of your hadoop distribution directory}</value>
</property>
8 N0 D, _, F3 s, H! x5 n<property>
1 F9 h  O% z+ k4 m: a1 G7 M" y  <name>mapreduce.reduce.env</name>
  <value>HADOOP_MAPRED_HOME=${full path of your hadoop distribution directory}</value>
9 l2 E1 E* t/ ?, L# P7 n$ a</property>
0 T" _8 a, K" e  Z* b0 I6 ]$ ~
. }' Q) q2 H' P/ uFor more detailed output, check the application tracking page: http://hadoop-2:8088/cluster/app/application_1668583281306_0001 Then click on links to logs of each attempt.
0 g& K# Q+ p, V3 }% C/ V. Failing the application.
' v: g& d; M4 A; @2022-11-16 15:32:41,608 INFO mapreduce.Job: Counters: 0
+ \( M+ i0 _) G2 }$ s  pJob job_1668583281306_0001 failed!
3 L  P- C% I& B$ h5 p* e
/ D% Q, `* z3 X, M" l分析失败，解决方法：

( d: f2 X( Q% X- l' x: G. M! U# C[admin@hadoop-1 hadoop-3.2.2]$ vim etc/hadoop/mapred-site.xml
* A& l4 D- S# b4 g添加如下内容：

3 ]' x! ~) ~9 G) W, P<property>
  <name>yarn.app.mapreduce.am.env</name>
* \3 F6 J" C2 v' }- }! c/ @  <value>HADOOP_MAPRED_HOME=${HADOOP_HOME}</value>
  s- Z! D, O, E' q</property>
<property>
! c* M; C5 \, y  <name>mapreduce.map.env</name>
  <value>HADOOP_MAPRED_HOME=${HADOOP_HOME}</value>
</property>
<property>
  <name>mapreduce.reduce.env</name>
  <value>HADOOP_MAPRED_HOME=${HADOOP_HOME}</value>
</property>
% |( ]: }  a5 B: ^. G
6 a3 L& B; \7 Y# ?  F9 Z
同步到其他节点：
, R' I+ N7 P+ C6 w8 }  z  S$ f
& Z( x+ u% Q3 X& Z


6 Z0 ]$ q" p! P$ A. h4 p[admin@hadoop-1 hadoop-3.2.2]$ xsync etc/hadoop/
3 E( u1 B1 w0 Y8 O==============hadoop-1==================
sending incremental file list
. \0 f( k, C  M" }( N
sent 1,004 bytes  received 18 bytes  2,044.00 bytes/sec
total size is 115,250  speedup is 112.77
" D) |( {( `) Y- g) F+ p' N==============hadoop-2==================
8 W/ e0 H) p+ o8 w: C- K7 A' ^sending incremental file list
1 [; \; ~" E" P% \9 nhadoop/
hadoop/mapred-site.xml

, }8 f0 P5 r" \3 W4 i: qsent 1,251 bytes  received 52 bytes  2,606.00 bytes/sec
" f) ~" `1 l- Ntotal size is 115,250  speedup is 88.45
==============hadoop-3==================
6 ]/ ^5 v; H1 r6 J8 ksending incremental file list
% K: L. f. h2 Y! x; Thadoop/
, |2 c( X# M5 h# uhadoop/mapred-site.xml

sent 1,251 bytes  received 52 bytes  2,606.00 bytes/sec
total size is 115,250  speedup is 88.45
: m. |  M. s" @4 a8 o

! _# m8 L7 }3 o5 O" o( e! P3 ?再次验证：

# x+ x9 r2 U) R: j. b[admin@hadoop-1 hadoop-3.2.2]$ hadoop jar /data/module/hadoop-3.2.2/share/hadoop/mapreduce/hadoop-mapreduce-examples-3.2.2.jar pi 10 100
Number of Maps  = 10
Samples per Map = 100
6 U* n4 Y) j# zWrote input for Map #0
Wrote input for Map #1
Wrote input for Map #2
' Q1 O- B3 X6 C" o. FWrote input for Map #3
; m8 q* `8 g. v$ U9 E! HWrote input for Map #4
* V  G  j' i1 v! S$ H0 pWrote input for Map #5
Wrote input for Map #6
6 S9 g2 ^, P# Y9 w5 ~9 MWrote input for Map #7
Wrote input for Map #8
Wrote input for Map #9
% O9 j* R% X8 E1 E0 q; ^( K- IStarting Job
2022-11-16 15:36:05,630 INFO client.ConfiguredRMFailoverProxyProvider: Failing over to rm2
: p3 u; @; Q, W) D: k! P2022-11-16 15:36:05,878 INFO mapreduce.JobResourceUploader: Disabling Erasure Coding for path: /tmp/hadoop-yarn/staging/admin/.staging/job_1668583281306_0002
9 Z6 D( M5 m6 o6 i; a4 G" u4 V2022-11-16 15:36:06,065 INFO input.FileInputFormat: Total input files to process : 10
2022-11-16 15:36:06,214 INFO mapreduce.JobSubmitter: number of splits:10
2022-11-16 15:36:06,444 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1668583281306_0002
2022-11-16 15:36:06,446 INFO mapreduce.JobSubmitter: Executing with tokens: []
2022-11-16 15:36:06,654 INFO conf.Configuration: resource-types.xml not found
2022-11-16 15:36:06,654 INFO resource.ResourceUtils: Unable to find 'resource-types.xml'.
2022-11-16 15:36:06,928 INFO impl.YarnClientImpl: Submitted application application_1668583281306_0002
2022-11-16 15:36:06,981 INFO mapreduce.Job: The url to track the job: http://hadoop-2:8088/proxy/application_1668583281306_0002/
2022-11-16 15:36:06,982 INFO mapreduce.Job: Running job: job_1668583281306_0002
1 b: D% `2 h  i. G1 c2022-11-16 15:36:17,134 INFO mapreduce.Job: Job job_1668583281306_0002 running in uber mode : false
2022-11-16 15:36:17,136 INFO mapreduce.Job:  map 0% reduce 0%
2022-11-16 15:36:23,297 INFO mapreduce.Job:  map 40% reduce 0%
2022-11-16 15:36:24,308 INFO mapreduce.Job:  map 100% reduce 0%
4 H2 s- R: V- P2022-11-16 15:36:28,342 INFO mapreduce.Job:  map 100% reduce 100%
' z- |5 b% r" z' e$ x2022-11-16 15:36:29,360 INFO mapreduce.Job: Job job_1668583281306_0002 completed successfully
1 ^1 y5 z' ]3 J9 w0 H. Q4 S2022-11-16 15:36:29,504 INFO mapreduce.Job: Counters: 54
! S# l, u) W# x9 B! X- b; z        File System Counters
. }) r6 s. J# ?8 E9 b                FILE: Number of bytes read=226
. t5 V1 R6 Q; y# h2 o5 b                FILE: Number of bytes written=2630034
                FILE: Number of read operations=0
                FILE: Number of large read operations=0
                FILE: Number of write operations=0
                HDFS: Number of bytes read=2600
6 F1 t: e/ T% \  N0 l5 C                HDFS: Number of bytes written=215
                HDFS: Number of read operations=45
                HDFS: Number of large read operations=0
                HDFS: Number of write operations=3
% A% C& `; `+ \: Q  Q" V% X                HDFS: Number of bytes read erasure-coded=0
        Job Counters
                Launched map tasks=10
                Launched reduce tasks=1
                Data-local map tasks=10
                Total time spent by all maps in occupied slots (ms)=41394
                Total time spent by all reduces in occupied slots (ms)=3116
                Total time spent by all map tasks (ms)=41394
                Total time spent by all reduce tasks (ms)=3116
                Total vcore-milliseconds taken by all map tasks=41394
$ W7 x. |3 j& r2 P4 ]                Total vcore-milliseconds taken by all reduce tasks=3116
                Total megabyte-milliseconds taken by all map tasks=42387456
! Q5 [1 v0 b1 m% X6 p7 Z  u6 O2 S5 D( A                Total megabyte-milliseconds taken by all reduce tasks=3190784
        Map-Reduce Framework
/ B6 Z$ A( j/ l* G) h- v                Map input records=10
. d$ g3 F2 q3 z2 l                Map output records=20
" ~2 U2 E# h3 \1 x' F; M/ @0 o                Map output bytes=180
  p8 d: y" W- y$ s+ W5 _; @4 ^                Map output materialized bytes=280
- O/ B6 h/ Z+ p                Input split bytes=1420
9 U5 W# v% z2 m9 H$ r7 @( h                Combine input records=0
" H  I: D3 [- q                Combine output records=0
$ X! `* u: [: @- \                Reduce input groups=2
                Reduce shuffle bytes=280
! S& O3 w/ o8 A. v% q0 f$ C                Reduce input records=20
0 D+ q& H) `# U) H# A                Reduce output records=0
                Spilled Records=40
  K6 s8 b: U- e0 w% I                Shuffled Maps =10
8 S+ B: d! z6 b                Failed Shuffles=0
                Merged Map outputs=10
7 |! B1 U7 K$ V" {( \. T2 a7 y                GC time elapsed (ms)=1915
                CPU time spent (ms)=6790
                Physical memory (bytes) snapshot=3809210368
& ]2 {+ D; f0 P% U9 s: E5 Y                Virtual memory (bytes) snapshot=31150141440
1 @: G. E1 p. [7 B/ r: T) c                Total committed heap usage (bytes)=3503292416
                Peak Map Physical memory (bytes)=360734720
% s9 @+ E* i5 e                Peak Map Virtual memory (bytes)=2835021824
                Peak Reduce Physical memory (bytes)=279707648
  D& X9 H' Q9 N$ Y0 n                Peak Reduce Virtual memory (bytes)=2839097344
        Shuffle Errors
                BAD_ID=0
6 u- a! U1 V# l5 N                CONNECTION=0
                IO_ERROR=0
                WRONG_LENGTH=0
                WRONG_MAP=0
0 o* k' M. }: K, J) ]                WRONG_REDUCE=0
  ^/ e" P6 f4 @        File Input Format Counters
5 Q5 X! S# D; _. f                Bytes Read=1180
        File Output Format Counters
$ P" n1 b$ W1 v  R4 W                Bytes Written=97
Job Finished in 24.227 seconds
Estimated value of Pi is 3.14800000000000000000

问题解决
# o: ?4 O; A" I$ n