Loading ...
Sorry, an error occurred while loading the content.

Re: Oozie error when submitting jobs

Expand Messages
  • Felix
    NN is running on a different box and so is JT. I do have access to NN and JT from localhost, the box that is used for oozie used to be the launchpad for all of
    Message 1 of 11 , Aug 24, 2011
    View Source
    • 0 Attachment
      NN is running on a different box and so is JT. I do have access to NN and JT from localhost, the box that is used for oozie used to be the launchpad for all of our pig jobs. When I do hadoop fs I will be able to view the HDFS for which ever user that I am logged in with.

      For my test pig I only have the following in the HDFS
      hadoop fs -ls /user/felix/oozie/workflows/test_pig
      Found 2 items
      -rw-r--r-- 2 felix supergroup 367 2011-08-23 14:28 /user/felix/oozie/workflows/test_pig/config-default.xml
      drwxr-xr-x - felix supergroup 0 2011-08-23 14:08 /user/felix/oozie/workflows/test_pig/lib


      The lib is empty right now.
      In my local directory I have
      ls -al
      total 28
      drwxrwxr-x 2 felix felix 4096 Aug 23 16:14 .
      drwxrwxr-x 3 felix felix 4096 Aug 23 13:07 ..
      -rw-rw-r-- 1 felix felix 367 Aug 23 14:28 config-default.xml
      -rw-rw-r-- 1 felix felix 486 Aug 23 15:56 job.properties
      -rw-rw-r-- 1 felix felix 309 Aug 23 15:02 pigexample.pig
      -rw-rw-r-- 1 felix felix 1190 Aug 23 15:41 pig-wf.xml
      -rwxrwxrwx 1 felix felix 929 Aug 23 16:09 submit.sh

      cat job.properties
      #The following attributes must be set
      fs.default.name=hdfs://namenode.xxx.xxx:50001
      mapred.job.tracker=jobtracker.xxx.xxx:50002
      oozie.use.system.libpath=true
      oozie.libpath=hdfs://namenode.xxx.xxx:50001/user/oozie/share/pig/lib/
      queueName=default
      #additional
      oozie.wf.application.path=hdfs://namenode.xxx.xxx:50001/user/felix/oozie/workflows/test_pig
      inputDir=/user/felix/test_input.data
      outputDir=/user/felix/oozie_output/pig_test

      I submitted the job to Oozie using
      oozie pig -oozie http://localhost:11000/oozie -file pigexample.pig -config job.properties

      hadoop we are using is 0.20.2 and oozie we are using is 2.3.0. Both are from cloudera's RPM.

      I hope this is clear enough.

      --- In Oozie-users@yahoogroups.com, Mohammad Islam <mislam77@...> wrote:
      >
      > Do you have the NN running on the same box?
      >
      > If not,  do you have the access from the localhost to NN? Did you able to run "haddop fs ..." command from the localhost?
      >
      >
      > Which version of hadoop and what version of oozie you are using?
      > What is the wf apppath in job.properties?
      >
      > Regards,
      > Mohammad
      >
      >
      >
      >
      > ________________________________
      > From: Felix <felixgao@...>
      > To: Oozie-users@yahoogroups.com
      > Sent: Tuesday, August 23, 2011 3:28 PM
      > Subject: [Oozie-users] Oozie error when submitting jobs
      >
      >
      >  
      > Hi all I have a simple pig job for testing that I would like to use oozie to manage. When I do the following I got
      >
      > oozie pig -oozie http://localhost:11000/oozie -file pigexample.pig -config job.properties
      > Error: E0902 : E0902: Exception occured: [java.io.IOException: Call to namenode/69.xxx.xxx.xxx:50001 failed on local exception: java.io.EOFException]
      >
      > 2011-08-23 17:18:11,861 WARN V1JobsServlet:528 - USER[felix] GROUP[users] TOKEN[-] APP[-] JOB[-] ACTION[-] URL[POST http://localhost:11000/oozie/v1/jobs?jobtype=pig] error[E0902], E0902: Exception occured: [java.io.IOException: Call to namenode/69.xxx.xxx.xxx:50001 failed on local exception: java.io.EOFException]
      > org.apache.oozie.servlet.XServletException: E0902: Exception occured: [java.io.IOException: Call to namenode/69.xxx.xxx.xxx:50001 failed on local exception: java.io.EOFException]
      > at org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.java:179)
      > at org.apache.oozie.servlet.BaseJobsServlet.doPost(BaseJobsServlet.java:89)
      > at javax.servlet.http.HttpServlet.service(HttpServlet.java:637)
      > at org.apache.oozie.servlet.JsonRestServlet.service(JsonRestServlet.java:281)
      > at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
      > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
      > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
      > at org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:123)
      > at com.cloudera.alfredo.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:371)
      > at org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:128)
      > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
      > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
      > at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
      > at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
      > at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
      > at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
      > at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
      > at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
      > at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857)
      > at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588)
      > at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
      > at java.lang.Thread.run(Thread.java:619)
      > Caused by: org.apache.oozie.service.AuthorizationException: E0902: Exception occured: [java.io.IOException: Call to namenode/69.xxx.xxx.xxx:50001 failed on local exception: java.io.EOFException]
      > at org.apache.oozie.service.AuthorizationService.authorizeForApp(AuthorizationService.java:318)
      > at org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.java:171)
      > ... 21 more
      > Caused by: org.apache.oozie.service.HadoopAccessorException: E0902: Exception occured: [java.io.IOException: Call to namenode.chi.bluekai.com/69.170.130.176:50001 failed on local exception: java.io.EOFException]
      > at org.apache.oozie.service.HadoopAccessorService.createFileSystem(HadoopAccessorService.java:144)
      > at org.apache.oozie.service.AuthorizationService.authorizeForApp(AuthorizationService.java:283)
      > ... 22 more
      > Caused by: java.io.IOException: Call to namenode/69.xxx.xxx.xxx:50001 failed on local exception: java.io.EOFException
      > at org.apache.hadoop.ipc.Client.wrapException(Client.java:1142)
      > at org.apache.hadoop.ipc.Client.call(Client.java:1110)
      > at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:226)
      > at $Proxy22.getProtocolVersion(Unknown Source)
      > at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:398)
      > at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:384)
      > at org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:111)
      > at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:213)
      > at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:180)
      > at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:89)
      > at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1514)
      > at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:67)
      > at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:1548)
      > at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1530)
      > at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:228)
      > at org.apache.oozie.service.HadoopAccessorService.createFileSystem(HadoopAccessorService.java:141)
      > ... 23 more
      > Caused by: java.io.EOFException
      > at java.io.DataInputStream.readInt(DataInputStream.java:375)
      > at org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:815)
      > at org.apache.hadoop.ipc.Client$Connection.run(Client.java:724)
      >
      > in my oozie-site.xml I have the following services
      > <property>
      > <name>oozie.services</name>
      > <value>
      > org.apache.oozie.service.SchedulerService,
      > org.apache.oozie.service.InstrumentationService,
      > org.apache.oozie.service.CallableQueueService,
      > org.apache.oozie.service.UUIDService,
      > org.apache.oozie.service.ELService,
      > org.apache.oozie.service.AuthorizationService,
      > org.apache.oozie.service.MemoryLocksService,
      > org.apache.oozie.service.DagXLogInfoService,
      > org.apache.oozie.service.SchemaService,
      > org.apache.oozie.service.LiteWorkflowAppService,
      > org.apache.oozie.service.StoreService,
      > org.apache.oozie.service.CoordinatorStoreService,
      > org.apache.oozie.service.SLAStoreService,
      > org.apache.oozie.service.DBLiteWorkflowStoreService,
      > org.apache.oozie.service.CallbackService,
      > org.apache.oozie.service.ActionService,
      > org.apache.oozie.service.ActionCheckerService,
      > org.apache.oozie.service.RecoveryService,
      > org.apache.oozie.service.PurgeService,
      > org.apache.oozie.service.CoordinatorEngineService,
      > org.apache.oozie.service.DagEngineService,
      > org.apache.oozie.service.CoordJobMatLookupTriggerService,
      > org.apache.oozie.service.HadoopAccessorService
      > </value>
      > <description>
      > All services to be created and managed by Oozie Services singleton.
      > Class names must be separated by commas.
      > </description>
      > </property>
      >
      > if I take out org.apache.oozie.service.HadoopAccessorService, then I will get
      > 2011-08-23 16:09:45,587 ERROR V1JobsServlet:522 - USER[felix] GROUP[users] TOKEN[-] APP[-] JOB[-] ACTION[-] URL[POST http://localhost:11000/oozie/v1/jobs?jobtype=pig] error, null
      > java.lang.NullPointerException
      > at org.apache.oozie.service.AuthorizationService.authorizeForApp(AuthorizationService.java:283)
      > at org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.java:171)
      > at org.apache.oozie.servlet.BaseJobsServlet.doPost(BaseJobsServlet.java:89)
      > at javax.servlet.http.HttpServlet.service(HttpServlet.java:637)
      > at org.apache.oozie.servlet.JsonRestServlet.service(JsonRestServlet.java:281)
      > at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
      > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
      > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
      > at org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:123)
      > at com.cloudera.alfredo.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:371)
      > at org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:128)
      > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
      > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
      > at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
      > at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
      > at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
      > at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
      > at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
      > at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
      > at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857)
      > at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588)
      > at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
      > at java.lang.Thread.run(Thread.java:619)
      >
      > your help is appreciated.
      >
      > Felix
      >
    • Alejandro Abdelnur
      Felix, What are doing that you need to modify the service classes? Thanks. Alejandro ... Felix, What are doing that you need to modify the service classes?
      Message 2 of 11 , Aug 24, 2011
      View Source
      • 0 Attachment
        Felix,

        What are doing that you need to modify the service classes?

        Thanks.

        Alejandro

        On Wed, Aug 24, 2011 at 9:53 AM, Felix <felixgao@...> wrote:
        NN is running on a different box and so is JT. I do have access to NN and JT from localhost, the box that is used for oozie used to be the launchpad for all of our pig jobs.  When I do hadoop fs I will be able to view the HDFS for which ever user that I am logged in with.

        For my test pig I only have the following in the HDFS
        hadoop fs -ls /user/felix/oozie/workflows/test_pig
        Found 2 items
        -rw-r--r--   2 felix supergroup        367 2011-08-23 14:28 /user/felix/oozie/workflows/test_pig/config-default.xml
        drwxr-xr-x   - felix supergroup          0 2011-08-23 14:08 /user/felix/oozie/workflows/test_pig/lib


        The lib is empty right now.
        In my local directory I have
        ls -al
        total 28
        drwxrwxr-x 2 felix felix 4096 Aug 23 16:14 .
        drwxrwxr-x 3 felix felix 4096 Aug 23 13:07 ..
        -rw-rw-r-- 1 felix felix  367 Aug 23 14:28 config-default.xml
        -rw-rw-r-- 1 felix felix  486 Aug 23 15:56 job.properties
        -rw-rw-r-- 1 felix felix  309 Aug 23 15:02 pigexample.pig
        -rw-rw-r-- 1 felix felix 1190 Aug 23 15:41 pig-wf.xml
        -rwxrwxrwx 1 felix felix  929 Aug 23 16:09 submit.sh

         cat job.properties
        #The following attributes must be set
        fs.default.name=hdfs://namenode.xxx.xxx:50001
        mapred.job.tracker=jobtracker.xxx.xxx:50002
        oozie.use.system.libpath=true
        oozie.libpath=hdfs://namenode.xxx.xxx:50001/user/oozie/share/pig/lib/
        queueName=default
        #additional
        oozie.wf.application.path=hdfs://namenode.xxx.xxx:50001/user/felix/oozie/workflows/test_pig
        inputDir=/user/felix/test_input.data
        outputDir=/user/felix/oozie_output/pig_test

        I submitted the job to Oozie using
        oozie pig -oozie http://localhost:11000/oozie -file pigexample.pig -config job.properties

        hadoop we are using is 0.20.2 and oozie we are using is 2.3.0. Both are from cloudera's RPM.

        I hope this is clear enough.

        --- In Oozie-users@yahoogroups.com, Mohammad Islam <mislam77@...> wrote:
        >
        > Do you have the NN running on the same box?
        >
        > If not,  do you have the access from the localhost to NN? Did you able to run "haddop fs ..." command from the localhost?
        >
        >
        > Which version of hadoop and what version of oozie you are using?
        > What is the wf apppath in job.properties?
        >
        > Regards,
        > Mohammad
        >
        >
        >
        >
        > ________________________________
        > From: Felix <felixgao@...>
        > To: Oozie-users@yahoogroups.com
        > Sent: Tuesday, August 23, 2011 3:28 PM
        > Subject: [Oozie-users] Oozie error when submitting jobs
        >
        >
        >  
        > Hi all I have a simple pig job for testing that I would like to use oozie to manage.  When I do the following I got
        >
        > oozie pig -oozie http://localhost:11000/oozie -file pigexample.pig -config job.properties
        > Error: E0902 : E0902: Exception occured: [java.io.IOException: Call to namenode/69.xxx.xxx.xxx:50001 failed on local exception: java.io.EOFException]
        >
        > 2011-08-23 17:18:11,861  WARN V1JobsServlet:528 - USER[felix] GROUP[users] TOKEN[-] APP[-] JOB[-] ACTION[-] URL[POST http://localhost:11000/oozie/v1/jobs?jobtype=pig] error[E0902], E0902: Exception occured: [java.io.IOException: Call to namenode/69.xxx.xxx.xxx:50001 failed on local exception: java.io.EOFException]
        > org.apache.oozie.servlet.XServletException: E0902: Exception occured: [java.io.IOException: Call to namenode/69.xxx.xxx.xxx:50001 failed on local exception: java.io.EOFException]
        > at org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.java:179)
        > at org.apache.oozie.servlet.BaseJobsServlet.doPost(BaseJobsServlet.java:89)
        > at javax.servlet.http.HttpServlet.service(HttpServlet.java:637)
        > at org.apache.oozie.servlet.JsonRestServlet.service(JsonRestServlet.java:281)
        > at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
        > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
        > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
        > at org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:123)
        > at com.cloudera.alfredo.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:371)
        > at org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:128)
        > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
        > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
        > at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
        > at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
        > at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
        > at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
        > at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
        > at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
        > at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857)
        > at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588)
        > at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
        > at java.lang.Thread.run(Thread.java:619)
        > Caused by: org.apache.oozie.service.AuthorizationException: E0902: Exception occured: [java.io.IOException: Call to namenode/69.xxx.xxx.xxx:50001 failed on local exception: java.io.EOFException]
        > at org.apache.oozie.service.AuthorizationService.authorizeForApp(AuthorizationService.java:318)
        > at org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.java:171)
        > ... 21 more
        > Caused by: org.apache.oozie.service.HadoopAccessorException: E0902: Exception occured: [java.io.IOException: Call to namenode.chi.bluekai.com/69.170.130.176:50001 failed on local exception: java.io.EOFException]
        > at org.apache.oozie.service.HadoopAccessorService.createFileSystem(HadoopAccessorService.java:144)
        > at org.apache.oozie.service.AuthorizationService.authorizeForApp(AuthorizationService.java:283)
        > ... 22 more
        > Caused by: java.io.IOException: Call to namenode/69.xxx.xxx.xxx:50001 failed on local exception: java.io.EOFException
        > at org.apache.hadoop.ipc.Client.wrapException(Client.java:1142)
        > at org.apache.hadoop.ipc.Client.call(Client.java:1110)
        > at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:226)
        > at $Proxy22.getProtocolVersion(Unknown Source)
        > at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:398)
        > at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:384)
        > at org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:111)
        > at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:213)
        > at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:180)
        > at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:89)
        > at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1514)
        > at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:67)
        > at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:1548)
        > at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1530)
        > at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:228)
        > at org.apache.oozie.service.HadoopAccessorService.createFileSystem(HadoopAccessorService.java:141)
        > ... 23 more
        > Caused by: java.io.EOFException
        > at java.io.DataInputStream.readInt(DataInputStream.java:375)
        > at org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:815)
        > at org.apache.hadoop.ipc.Client$Connection.run(Client.java:724)
        >
        > in my oozie-site.xml I have the following services
        > <property>
        > <name>oozie.services</name>
        > <value>
        > org.apache.oozie.service.SchedulerService,
        > org.apache.oozie.service.InstrumentationService,
        > org.apache.oozie.service.CallableQueueService,
        > org.apache.oozie.service.UUIDService,
        > org.apache.oozie.service.ELService,
        > org.apache.oozie.service.AuthorizationService,
        > org.apache.oozie.service.MemoryLocksService,
        > org.apache.oozie.service.DagXLogInfoService,
        > org.apache.oozie.service.SchemaService,
        > org.apache.oozie.service.LiteWorkflowAppService,
        > org.apache.oozie.service.StoreService,
        > org.apache.oozie.service.CoordinatorStoreService,
        > org.apache.oozie.service.SLAStoreService,
        > org.apache.oozie.service.DBLiteWorkflowStoreService,
        > org.apache.oozie.service.CallbackService,
        > org.apache.oozie.service.ActionService,
        > org.apache.oozie.service.ActionCheckerService,
        > org.apache.oozie.service.RecoveryService,
        > org.apache.oozie.service.PurgeService,
        > org.apache.oozie.service.CoordinatorEngineService,
        > org.apache.oozie.service.DagEngineService,
        > org.apache.oozie.service.CoordJobMatLookupTriggerService,
        > org.apache.oozie.service.HadoopAccessorService
        > </value>
        > <description>
        > All services to be created and managed by Oozie Services singleton.
        > Class names must be separated by commas.
        > </description>
        > </property>
        >
        > if I take out org.apache.oozie.service.HadoopAccessorService, then I will get
        > 2011-08-23 16:09:45,587 ERROR V1JobsServlet:522 - USER[felix] GROUP[users] TOKEN[-] APP[-] JOB[-] ACTION[-] URL[POST http://localhost:11000/oozie/v1/jobs?jobtype=pig] error, null
        > java.lang.NullPointerException
        > at org.apache.oozie.service.AuthorizationService.authorizeForApp(AuthorizationService.java:283)
        > at org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.java:171)
        > at org.apache.oozie.servlet.BaseJobsServlet.doPost(BaseJobsServlet.java:89)
        > at javax.servlet.http.HttpServlet.service(HttpServlet.java:637)
        > at org.apache.oozie.servlet.JsonRestServlet.service(JsonRestServlet.java:281)
        > at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
        > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
        > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
        > at org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:123)
        > at com.cloudera.alfredo.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:371)
        > at org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:128)
        > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
        > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
        > at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
        > at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
        > at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
        > at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
        > at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
        > at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
        > at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857)
        > at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588)
        > at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
        > at java.lang.Thread.run(Thread.java:619)
        >
        > your help is appreciated.
        >
        > Felix
        >




        ------------------------------------

        Yahoo! Groups Links

        <*> To visit your group on the web, go to:
           http://groups.yahoo.com/group/Oozie-users/

        <*> Your email settings:
           Individual Email | Traditional

        <*> To change settings online go to:
           http://groups.yahoo.com/group/Oozie-users/join
           (Yahoo! ID required)

        <*> To change settings via email:
           Oozie-users-digest@yahoogroups.com
           Oozie-users-fullfeatured@yahoogroups.com

        <*> To unsubscribe from this group, send an email to:
           Oozie-users-unsubscribe@yahoogroups.com

        <*> Your use of Yahoo! Groups is subject to:
           http://docs.yahoo.com/info/terms/


      • Felix
        Alejandro, I am modifying the oozie.services to oozie.services org.apache.oozie.service.SchedulerService,
        Message 3 of 11 , Aug 24, 2011
        View Source
        • 0 Attachment
          Alejandro,

          I am modifying the oozie.services to
          <property>
          <name>oozie.services</name>
          <value>
          org.apache.oozie.service.SchedulerService,
          org.apache.oozie.service.InstrumentationService,
          org.apache.oozie.service.CallableQueueService,
          org.apache.oozie.service.UUIDService,
          org.apache.oozie.service.ELService,
          org.apache.oozie.service.AuthorizationService,
          org.apache.oozie.service.MemoryLocksService,
          org.apache.oozie.service.DagXLogInfoService,
          org.apache.oozie.service.SchemaService,
          org.apache.oozie.service.LiteWorkflowAppService,
          org.apache.oozie.service.StoreService,
          org.apache.oozie.service.CoordinatorStoreService,
          org.apache.oozie.service.SLAStoreService,
          org.apache.oozie.service.DBLiteWorkflowStoreService,
          org.apache.oozie.service.CallbackService,
          org.apache.oozie.service.ActionService,
          org.apache.oozie.service.ActionCheckerService,
          org.apache.oozie.service.RecoveryService,
          org.apache.oozie.service.PurgeService,
          org.apache.oozie.service.CoordinatorEngineService,
          org.apache.oozie.service.DagEngineService,
          org.apache.oozie.service.CoordJobMatLookupTriggerService,
          org.apache.oozie.service.HadoopAccessorService
          </value>
          <description>
          All services to be created and managed by Oozie Services singleton.
          Class names must be separated by commas.
          </description>
          </property>

          because I am seeing E0902: Exception occured: so https://github.com/yahoo/oozie/wiki/FAQ told me to add those to the xml file.

          --- In Oozie-users@yahoogroups.com, Alejandro Abdelnur <tucu@...> wrote:
          >
          > Felix,
          >
          > What are doing that you need to modify the service classes?
          >
          > Thanks.
          >
          > Alejandro
          >
          > On Wed, Aug 24, 2011 at 9:53 AM, Felix <felixgao@...> wrote:
          >
          > > NN is running on a different box and so is JT. I do have access to NN and
          > > JT from localhost, the box that is used for oozie used to be the launchpad
          > > for all of our pig jobs. When I do hadoop fs I will be able to view the
          > > HDFS for which ever user that I am logged in with.
          > >
          > > For my test pig I only have the following in the HDFS
          > > hadoop fs -ls /user/felix/oozie/workflows/test_pig
          > > Found 2 items
          > > -rw-r--r-- 2 felix supergroup 367 2011-08-23 14:28
          > > /user/felix/oozie/workflows/test_pig/config-default.xml
          > > drwxr-xr-x - felix supergroup 0 2011-08-23 14:08
          > > /user/felix/oozie/workflows/test_pig/lib
          > >
          > >
          > > The lib is empty right now.
          > > In my local directory I have
          > > ls -al
          > > total 28
          > > drwxrwxr-x 2 felix felix 4096 Aug 23 16:14 .
          > > drwxrwxr-x 3 felix felix 4096 Aug 23 13:07 ..
          > > -rw-rw-r-- 1 felix felix 367 Aug 23 14:28 config-default.xml
          > > -rw-rw-r-- 1 felix felix 486 Aug 23 15:56 job.properties
          > > -rw-rw-r-- 1 felix felix 309 Aug 23 15:02 pigexample.pig
          > > -rw-rw-r-- 1 felix felix 1190 Aug 23 15:41 pig-wf.xml
          > > -rwxrwxrwx 1 felix felix 929 Aug 23 16:09 submit.sh
          > >
          > > cat job.properties
          > > #The following attributes must be set
          > > fs.default.name=hdfs://namenode.xxx.xxx:50001
          > > mapred.job.tracker=jobtracker.xxx.xxx:50002
          > > oozie.use.system.libpath=true
          > > oozie.libpath=hdfs://namenode.xxx.xxx:50001/user/oozie/share/pig/lib/
          > > queueName=default
          > > #additional
          > >
          > > oozie.wf.application.path=hdfs://namenode.xxx.xxx:50001/user/felix/oozie/workflows/test_pig
          > > inputDir=/user/felix/test_input.data
          > > outputDir=/user/felix/oozie_output/pig_test
          > >
          > > I submitted the job to Oozie using
          > > oozie pig -oozie http://localhost:11000/oozie -file pigexample.pig -config
          > > job.properties
          > >
          > > hadoop we are using is 0.20.2 and oozie we are using is 2.3.0. Both are
          > > from cloudera's RPM.
          > >
          > > I hope this is clear enough.
          > >
          > > --- In Oozie-users@yahoogroups.com, Mohammad Islam <mislam77@> wrote:
          > > >
          > > > Do you have the NN running on the same box?
          > > >
          > > > If not, do you have the access from the localhost to NN? Did you able
          > > to run "haddop fs ..." command from the localhost?
          > > >
          > > >
          > > > Which version of hadoop and what version of oozie you are using?
          > > > What is the wf apppath in job.properties?
          > > >
          > > > Regards,
          > > > Mohammad
          > > >
          > > >
          > > >
          > > >
          > > > ________________________________
          > > > From: Felix <felixgao@>
          > > > To: Oozie-users@yahoogroups.com
          > > > Sent: Tuesday, August 23, 2011 3:28 PM
          > > > Subject: [Oozie-users] Oozie error when submitting jobs
          > > >
          > > >
          > > > Â
          > > > Hi all I have a simple pig job for testing that I would like to use oozie
          > > to manage. When I do the following I got
          > > >
          > > > oozie pig -oozie http://localhost:11000/oozie -file pigexample.pig
          > > -config job.properties
          > > > Error: E0902 : E0902: Exception occured: [java.io.IOException: Call to
          > > namenode/69.xxx.xxx.xxx:50001 failed on local exception:
          > > java.io.EOFException]
          > > >
          > > > 2011-08-23 17:18:11,861 WARN V1JobsServlet:528 - USER[felix]
          > > GROUP[users] TOKEN[-] APP[-] JOB[-] ACTION[-] URL[POST
          > > http://localhost:11000/oozie/v1/jobs?jobtype=pig] error[E0902], E0902:
          > > Exception occured: [java.io.IOException: Call to
          > > namenode/69.xxx.xxx.xxx:50001 failed on local exception:
          > > java.io.EOFException]
          > > > org.apache.oozie.servlet.XServletException: E0902: Exception occured:
          > > [java.io.IOException: Call to namenode/69.xxx.xxx.xxx:50001 failed on local
          > > exception: java.io.EOFException]
          > > > at
          > > org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.java:179)
          > > > at
          > > org.apache.oozie.servlet.BaseJobsServlet.doPost(BaseJobsServlet.java:89)
          > > > at javax.servlet.http.HttpServlet.service(HttpServlet.java:637)
          > > > at
          > > org.apache.oozie.servlet.JsonRestServlet.service(JsonRestServlet.java:281)
          > > > at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
          > > > at
          > > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
          > > > at
          > > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
          > > > at org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:123)
          > > > at
          > > com.cloudera.alfredo.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:371)
          > > > at org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:128)
          > > > at
          > > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
          > > > at
          > > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
          > > > at
          > > org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
          > > > at
          > > org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
          > > > at
          > > org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
          > > > at
          > > org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
          > > > at
          > > org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
          > > > at
          > > org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
          > > > at
          > > org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857)
          > > > at
          > > org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588)
          > > > at
          > > org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
          > > > at java.lang.Thread.run(Thread.java:619)
          > > > Caused by: org.apache.oozie.service.AuthorizationException: E0902:
          > > Exception occured: [java.io.IOException: Call to
          > > namenode/69.xxx.xxx.xxx:50001 failed on local exception:
          > > java.io.EOFException]
          > > > at
          > > org.apache.oozie.service.AuthorizationService.authorizeForApp(AuthorizationService.java:318)
          > > > at
          > > org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.java:171)
          > > > ... 21 more
          > > > Caused by: org.apache.oozie.service.HadoopAccessorException: E0902:
          > > Exception occured: [java.io.IOException: Call to
          > > namenode.chi.bluekai.com/69.170.130.176:50001 failed on local exception:
          > > java.io.EOFException]
          > > > at
          > > org.apache.oozie.service.HadoopAccessorService.createFileSystem(HadoopAccessorService.java:144)
          > > > at
          > > org.apache.oozie.service.AuthorizationService.authorizeForApp(AuthorizationService.java:283)
          > > > ... 22 more
          > > > Caused by: java.io.IOException: Call to namenode/69.xxx.xxx.xxx:50001
          > > failed on local exception: java.io.EOFException
          > > > at org.apache.hadoop.ipc.Client.wrapException(Client.java:1142)
          > > > at org.apache.hadoop.ipc.Client.call(Client.java:1110)
          > > > at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:226)
          > > > at $Proxy22.getProtocolVersion(Unknown Source)
          > > > at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:398)
          > > > at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:384)
          > > > at org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:111)
          > > > at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:213)
          > > > at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:180)
          > > > at
          > > org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:89)
          > > > at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1514)
          > > > at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:67)
          > > > at
          > > org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:1548)
          > > > at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1530)
          > > > at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:228)
          > > > at
          > > org.apache.oozie.service.HadoopAccessorService.createFileSystem(HadoopAccessorService.java:141)
          > > > ... 23 more
          > > > Caused by: java.io.EOFException
          > > > at java.io.DataInputStream.readInt(DataInputStream.java:375)
          > > > at
          > > org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:815)
          > > > at org.apache.hadoop.ipc.Client$Connection.run(Client.java:724)
          > > >
          > > > in my oozie-site.xml I have the following services
          > > > <property>
          > > > <name>oozie.services</name>
          > > > <value>
          > > > org.apache.oozie.service.SchedulerService,
          > > > org.apache.oozie.service.InstrumentationService,
          > > > org.apache.oozie.service.CallableQueueService,
          > > > org.apache.oozie.service.UUIDService,
          > > > org.apache.oozie.service.ELService,
          > > > org.apache.oozie.service.AuthorizationService,
          > > > org.apache.oozie.service.MemoryLocksService,
          > > > org.apache.oozie.service.DagXLogInfoService,
          > > > org.apache.oozie.service.SchemaService,
          > > > org.apache.oozie.service.LiteWorkflowAppService,
          > > > org.apache.oozie.service.StoreService,
          > > > org.apache.oozie.service.CoordinatorStoreService,
          > > > org.apache.oozie.service.SLAStoreService,
          > > > org.apache.oozie.service.DBLiteWorkflowStoreService,
          > > > org.apache.oozie.service.CallbackService,
          > > > org.apache.oozie.service.ActionService,
          > > > org.apache.oozie.service.ActionCheckerService,
          > > > org.apache.oozie.service.RecoveryService,
          > > > org.apache.oozie.service.PurgeService,
          > > > org.apache.oozie.service.CoordinatorEngineService,
          > > > org.apache.oozie.service.DagEngineService,
          > > > org.apache.oozie.service.CoordJobMatLookupTriggerService,
          > > > org.apache.oozie.service.HadoopAccessorService
          > > > </value>
          > > > <description>
          > > > All services to be created and managed by Oozie Services singleton.
          > > > Class names must be separated by commas.
          > > > </description>
          > > > </property>
          > > >
          > > > if I take out org.apache.oozie.service.HadoopAccessorService, then I will
          > > get
          > > > 2011-08-23 16:09:45,587 ERROR V1JobsServlet:522 - USER[felix]
          > > GROUP[users] TOKEN[-] APP[-] JOB[-] ACTION[-] URL[POST
          > > http://localhost:11000/oozie/v1/jobs?jobtype=pig] error, null
          > > > java.lang.NullPointerException
          > > > at
          > > org.apache.oozie.service.AuthorizationService.authorizeForApp(AuthorizationService.java:283)
          > > > at
          > > org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.java:171)
          > > > at
          > > org.apache.oozie.servlet.BaseJobsServlet.doPost(BaseJobsServlet.java:89)
          > > > at javax.servlet.http.HttpServlet.service(HttpServlet.java:637)
          > > > at
          > > org.apache.oozie.servlet.JsonRestServlet.service(JsonRestServlet.java:281)
          > > > at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
          > > > at
          > > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
          > > > at
          > > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
          > > > at org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:123)
          > > > at
          > > com.cloudera.alfredo.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:371)
          > > > at org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:128)
          > > > at
          > > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
          > > > at
          > > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
          > > > at
          > > org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
          > > > at
          > > org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
          > > > at
          > > org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
          > > > at
          > > org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
          > > > at
          > > org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
          > > > at
          > > org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
          > > > at
          > > org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857)
          > > > at
          > > org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588)
          > > > at
          > > org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
          > > > at java.lang.Thread.run(Thread.java:619)
          > > >
          > > > your help is appreciated.
          > > >
          > > > Felix
          > > >
          > >
          > >
          > >
          > >
          > > ------------------------------------
          > >
          > > Yahoo! Groups Links
          > >
          > >
          > >
          > >
          >
        • Alejandro Abdelnur
          Felix, [moving from oozie-users@ (in BCC) to cdh-user@ alias as this seems a CDH setup problem] If you are using RPM CDH Hadoop and Oozie, you don t have to
          Message 4 of 11 , Aug 24, 2011
          View Source
          • 0 Attachment
            Felix,

            [moving from oozie-users@  (in BCC) to cdh-user@ alias as this seems a CDH setup  problem]

            If you are using RPM CDH Hadoop and Oozie, you don't have to modify the HadoopAccessorService.

            Everything should work out of the box with zero configuration.

            Would you try to revert to a clean install and see if you have issues there?

            Thxs.

            Alejandro



            On Wed, Aug 24, 2011 at 11:15 AM, Felix <felixgao@...> wrote:
            Alejandro,

            I am modifying the oozie.services to
            <property>
                   <name>oozie.services</name>
                   <value>
                       org.apache.oozie.service.SchedulerService,
                       org.apache.oozie.service.InstrumentationService,
                       org.apache.oozie.service.CallableQueueService,
                       org.apache.oozie.service.UUIDService,
                       org.apache.oozie.service.ELService,
                       org.apache.oozie.service.AuthorizationService,
                       org.apache.oozie.service.MemoryLocksService,
                       org.apache.oozie.service.DagXLogInfoService,
                       org.apache.oozie.service.SchemaService,
                       org.apache.oozie.service.LiteWorkflowAppService,
                       org.apache.oozie.service.StoreService,
                       org.apache.oozie.service.CoordinatorStoreService,
                       org.apache.oozie.service.SLAStoreService,
                       org.apache.oozie.service.DBLiteWorkflowStoreService,
                       org.apache.oozie.service.CallbackService,
                       org.apache.oozie.service.ActionService,
                       org.apache.oozie.service.ActionCheckerService,
                       org.apache.oozie.service.RecoveryService,
                       org.apache.oozie.service.PurgeService,
                       org.apache.oozie.service.CoordinatorEngineService,
                       org.apache.oozie.service.DagEngineService,
                       org.apache.oozie.service.CoordJobMatLookupTriggerService,
                       org.apache.oozie.service.HadoopAccessorService
                   </value>
                   <description>
                       All services to be created and managed by Oozie Services singleton.
                       Class names must be separated by commas.
                   </description>
               </property>

            because I am seeing E0902: Exception occured:  so https://github.com/yahoo/oozie/wiki/FAQ told me to add those to the xml file.

            --- In Oozie-users@yahoogroups.com, Alejandro Abdelnur <tucu@...> wrote:
            >
            > Felix,
            >
            > What are doing that you need to modify the service classes?
            >
            > Thanks.
            >
            > Alejandro
            >
            > On Wed, Aug 24, 2011 at 9:53 AM, Felix <felixgao@...> wrote:
            >
            > > NN is running on a different box and so is JT. I do have access to NN and
            > > JT from localhost, the box that is used for oozie used to be the launchpad
            > > for all of our pig jobs.  When I do hadoop fs I will be able to view the
            > > HDFS for which ever user that I am logged in with.
            > >
            > > For my test pig I only have the following in the HDFS
            > > hadoop fs -ls /user/felix/oozie/workflows/test_pig
            > > Found 2 items
            > > -rw-r--r--   2 felix supergroup        367 2011-08-23 14:28
            > > /user/felix/oozie/workflows/test_pig/config-default.xml
            > > drwxr-xr-x   - felix supergroup          0 2011-08-23 14:08
            > > /user/felix/oozie/workflows/test_pig/lib
            > >
            > >
            > > The lib is empty right now.
            > > In my local directory I have
            > > ls -al
            > > total 28
            > > drwxrwxr-x 2 felix felix 4096 Aug 23 16:14 .
            > > drwxrwxr-x 3 felix felix 4096 Aug 23 13:07 ..
            > > -rw-rw-r-- 1 felix felix  367 Aug 23 14:28 config-default.xml
            > > -rw-rw-r-- 1 felix felix  486 Aug 23 15:56 job.properties
            > > -rw-rw-r-- 1 felix felix  309 Aug 23 15:02 pigexample.pig
            > > -rw-rw-r-- 1 felix felix 1190 Aug 23 15:41 pig-wf.xml
            > > -rwxrwxrwx 1 felix felix  929 Aug 23 16:09 submit.sh
            > >
            > >  cat job.properties
            > > #The following attributes must be set
            > > fs.default.name=hdfs://namenode.xxx.xxx:50001
            > > mapred.job.tracker=jobtracker.xxx.xxx:50002
            > > oozie.use.system.libpath=true
            > > oozie.libpath=hdfs://namenode.xxx.xxx:50001/user/oozie/share/pig/lib/
            > > queueName=default
            > > #additional
            > >
            > > oozie.wf.application.path=hdfs://namenode.xxx.xxx:50001/user/felix/oozie/workflows/test_pig
            > > inputDir=/user/felix/test_input.data
            > > outputDir=/user/felix/oozie_output/pig_test
            > >
            > > I submitted the job to Oozie using
            > > oozie pig -oozie http://localhost:11000/oozie -file pigexample.pig -config
            > > job.properties
            > >
            > > hadoop we are using is 0.20.2 and oozie we are using is 2.3.0. Both are
            > > from cloudera's RPM.
            > >
            > > I hope this is clear enough.
            > >
            > > --- In Oozie-users@yahoogroups.com, Mohammad Islam <mislam77@> wrote:
            > > >
            > > > Do you have the NN running on the same box?
            > > >
            > > > If not,  do you have the access from the localhost to NN? Did you able
            > > to run "haddop fs ..." command from the localhost?
            > > >
            > > >
            > > > Which version of hadoop and what version of oozie you are using?
            > > > What is the wf apppath in job.properties?
            > > >
            > > > Regards,
            > > > Mohammad
            > > >
            > > >
            > > >
            > > >
            > > > ________________________________
            > > > From: Felix <felixgao@>
            > > > To: Oozie-users@yahoogroups.com
            > > > Sent: Tuesday, August 23, 2011 3:28 PM
            > > > Subject: [Oozie-users] Oozie error when submitting jobs
            > > >
            > > >
            > > > Â
            > > > Hi all I have a simple pig job for testing that I would like to use oozie
            > > to manage.  When I do the following I got
            > > >
            > > > oozie pig -oozie http://localhost:11000/oozie -file pigexample.pig
            > > -config job.properties
            > > > Error: E0902 : E0902: Exception occured: [java.io.IOException: Call to
            > > namenode/69.xxx.xxx.xxx:50001 failed on local exception:
            > > java.io.EOFException]
            > > >
            > > > 2011-08-23 17:18:11,861  WARN V1JobsServlet:528 - USER[felix]
            > > GROUP[users] TOKEN[-] APP[-] JOB[-] ACTION[-] URL[POST
            > > http://localhost:11000/oozie/v1/jobs?jobtype=pig] error[E0902], E0902:
            > > Exception occured: [java.io.IOException: Call to
            > > namenode/69.xxx.xxx.xxx:50001 failed on local exception:
            > > java.io.EOFException]
            > > > org.apache.oozie.servlet.XServletException: E0902: Exception occured:
            > > [java.io.IOException: Call to namenode/69.xxx.xxx.xxx:50001 failed on local
            > > exception: java.io.EOFException]
            > > > at
            > > org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.java:179)
            > > > at
            > > org.apache.oozie.servlet.BaseJobsServlet.doPost(BaseJobsServlet.java:89)
            > > > at javax.servlet.http.HttpServlet.service(HttpServlet.java:637)
            > > > at
            > > org.apache.oozie.servlet.JsonRestServlet.service(JsonRestServlet.java:281)
            > > > at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
            > > > at
            > > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
            > > > at
            > > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
            > > > at org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:123)
            > > > at
            > > com.cloudera.alfredo.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:371)
            > > > at org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:128)
            > > > at
            > > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
            > > > at
            > > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
            > > > at
            > > org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
            > > > at
            > > org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
            > > > at
            > > org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
            > > > at
            > > org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
            > > > at
            > > org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
            > > > at
            > > org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
            > > > at
            > > org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857)
            > > > at
            > > org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588)
            > > > at
            > > org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
            > > > at java.lang.Thread.run(Thread.java:619)
            > > > Caused by: org.apache.oozie.service.AuthorizationException: E0902:
            > > Exception occured: [java.io.IOException: Call to
            > > namenode/69.xxx.xxx.xxx:50001 failed on local exception:
            > > java.io.EOFException]
            > > > at
            > > org.apache.oozie.service.AuthorizationService.authorizeForApp(AuthorizationService.java:318)
            > > > at
            > > org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.java:171)
            > > > ... 21 more
            > > > Caused by: org.apache.oozie.service.HadoopAccessorException: E0902:
            > > Exception occured: [java.io.IOException: Call to
            > > namenode.chi.bluekai.com/69.170.130.176:50001 failed on local exception:
            > > java.io.EOFException]
            > > > at
            > > org.apache.oozie.service.HadoopAccessorService.createFileSystem(HadoopAccessorService.java:144)
            > > > at
            > > org.apache.oozie.service.AuthorizationService.authorizeForApp(AuthorizationService.java:283)
            > > > ... 22 more
            > > > Caused by: java.io.IOException: Call to namenode/69.xxx.xxx.xxx:50001
            > > failed on local exception: java.io.EOFException
            > > > at org.apache.hadoop.ipc.Client.wrapException(Client.java:1142)
            > > > at org.apache.hadoop.ipc.Client.call(Client.java:1110)
            > > > at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:226)
            > > > at $Proxy22.getProtocolVersion(Unknown Source)
            > > > at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:398)
            > > > at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:384)
            > > > at org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:111)
            > > > at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:213)
            > > > at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:180)
            > > > at
            > > org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:89)
            > > > at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1514)
            > > > at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:67)
            > > > at
            > > org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:1548)
            > > > at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1530)
            > > > at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:228)
            > > > at
            > > org.apache.oozie.service.HadoopAccessorService.createFileSystem(HadoopAccessorService.java:141)
            > > > ... 23 more
            > > > Caused by: java.io.EOFException
            > > > at java.io.DataInputStream.readInt(DataInputStream.java:375)
            > > > at
            > > org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:815)
            > > > at org.apache.hadoop.ipc.Client$Connection.run(Client.java:724)
            > > >
            > > > in my oozie-site.xml I have the following services
            > > > <property>
            > > > <name>oozie.services</name>
            > > > <value>
            > > > org.apache.oozie.service.SchedulerService,
            > > > org.apache.oozie.service.InstrumentationService,
            > > > org.apache.oozie.service.CallableQueueService,
            > > > org.apache.oozie.service.UUIDService,
            > > > org.apache.oozie.service.ELService,
            > > > org.apache.oozie.service.AuthorizationService,
            > > > org.apache.oozie.service.MemoryLocksService,
            > > > org.apache.oozie.service.DagXLogInfoService,
            > > > org.apache.oozie.service.SchemaService,
            > > > org.apache.oozie.service.LiteWorkflowAppService,
            > > > org.apache.oozie.service.StoreService,
            > > > org.apache.oozie.service.CoordinatorStoreService,
            > > > org.apache.oozie.service.SLAStoreService,
            > > > org.apache.oozie.service.DBLiteWorkflowStoreService,
            > > > org.apache.oozie.service.CallbackService,
            > > > org.apache.oozie.service.ActionService,
            > > > org.apache.oozie.service.ActionCheckerService,
            > > > org.apache.oozie.service.RecoveryService,
            > > > org.apache.oozie.service.PurgeService,
            > > > org.apache.oozie.service.CoordinatorEngineService,
            > > > org.apache.oozie.service.DagEngineService,
            > > > org.apache.oozie.service.CoordJobMatLookupTriggerService,
            > > > org.apache.oozie.service.HadoopAccessorService
            > > > </value>
            > > > <description>
            > > > All services to be created and managed by Oozie Services singleton.
            > > > Class names must be separated by commas.
            > > > </description>
            > > > </property>
            > > >
            > > > if I take out org.apache.oozie.service.HadoopAccessorService, then I will
            > > get
            > > > 2011-08-23 16:09:45,587 ERROR V1JobsServlet:522 - USER[felix]
            > > GROUP[users] TOKEN[-] APP[-] JOB[-] ACTION[-] URL[POST
            > > http://localhost:11000/oozie/v1/jobs?jobtype=pig] error, null
            > > > java.lang.NullPointerException
            > > > at
            > > org.apache.oozie.service.AuthorizationService.authorizeForApp(AuthorizationService.java:283)
            > > > at
            > > org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.java:171)
            > > > at
            > > org.apache.oozie.servlet.BaseJobsServlet.doPost(BaseJobsServlet.java:89)
            > > > at javax.servlet.http.HttpServlet.service(HttpServlet.java:637)
            > > > at
            > > org.apache.oozie.servlet.JsonRestServlet.service(JsonRestServlet.java:281)
            > > > at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
            > > > at
            > > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
            > > > at
            > > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
            > > > at org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:123)
            > > > at
            > > com.cloudera.alfredo.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:371)
            > > > at org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:128)
            > > > at
            > > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
            > > > at
            > > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
            > > > at
            > > org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
            > > > at
            > > org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
            > > > at
            > > org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
            > > > at
            > > org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
            > > > at
            > > org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
            > > > at
            > > org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
            > > > at
            > > org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857)
            > > > at
            > > org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588)
            > > > at
            > > org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
            > > > at java.lang.Thread.run(Thread.java:619)
            > > >
            > > > your help is appreciated.
            > > >
            > > > Felix
            > > >
            > >
            > >
            > >
            > >
            > > ------------------------------------
            > >
            > > Yahoo! Groups Links
            > >
            > >
            > >
            > >
            >




            ------------------------------------

            Yahoo! Groups Links

            <*> To visit your group on the web, go to:
               http://groups.yahoo.com/group/Oozie-users/

            <*> Your email settings:
               Individual Email | Traditional

            <*> To change settings online go to:
               http://groups.yahoo.com/group/Oozie-users/join
               (Yahoo! ID required)

            <*> To change settings via email:
               Oozie-users-digest@yahoogroups.com
               Oozie-users-fullfeatured@yahoogroups.com

            <*> To unsubscribe from this group, send an email to:
               Oozie-users-unsubscribe@yahoogroups.com

            <*> Your use of Yahoo! Groups is subject to:
               http://docs.yahoo.com/info/terms/


          • Felix
            When reverted to the stock oozie-site.xml except I have changed the database to use mysql instead of derby. I still have the exception below. 2011-08-24
            Message 5 of 11 , Aug 24, 2011
            View Source
            • 0 Attachment
              When reverted to the stock oozie-site.xml except I have changed the database to use mysql instead of derby. I still have the exception below.

              2011-08-24 13:58:40,107 WARN V1JobsServlet:528 - USER[felix] GROUP[users] TOKEN[-] APP[-] JOB[-] ACTION[-] URL[POST http://localhost:11000/oozie/v1/jobs?jobtype=pig] error[E0902], E0902: Exception occured: [java.io.IOException: Call to namenode.xxx/69.xxx.xxx.xxx:50001 failed on local exception: java.io.EOFException]
              org.apache.oozie.servlet.XServletException: E0902: Exception occured: [java.io.IOException: Call to namenode.xxx/69.xxx.xxx.xxx:50001 failed on local exception: java.io.EOFException]
              at org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.java:179)
              at org.apache.oozie.servlet.BaseJobsServlet.doPost(BaseJobsServlet.java:89)
              at javax.servlet.http.HttpServlet.service(HttpServlet.java:637)
              at org.apache.oozie.servlet.JsonRestServlet.service(JsonRestServlet.java:281)
              at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
              at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
              at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
              at org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:123)
              at com.cloudera.alfredo.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:371)
              at org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:128)
              at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
              at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
              at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
              at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
              at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
              at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
              at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
              at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
              at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857)
              at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588)
              at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
              at java.lang.Thread.run(Thread.java:619)
              Caused by: org.apache.oozie.service.AuthorizationException: E0902: Exception occured: [java.io.IOException: Call to namenode.xxx/69.xxx.xxx.xxx:50001 failed on local exception: java.io.EOFException]
              at org.apache.oozie.service.AuthorizationService.authorizeForApp(AuthorizationService.java:318)
              at org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.java:171)
              ... 21 more
              Caused by: org.apache.oozie.service.HadoopAccessorException: E0902: Exception occured: [java.io.IOException: Call to namenode.chi.bluekai.com/69.170.130.176:50001 failed on local exception: java.io.EOFException]
              at org.apache.oozie.service.KerberosHadoopAccessorService.createFileSystem(KerberosHadoopAccessorService.java:211)
              at org.apache.oozie.service.AuthorizationService.authorizeForApp(AuthorizationService.java:283)
              ... 22 more
              Caused by: java.io.IOException: Call to namenode.xxx/69.xxx.xxx.xxx:50001 failed on local exception: java.io.EOFException
              at org.apache.hadoop.ipc.Client.wrapException(Client.java:1142)
              at org.apache.hadoop.ipc.Client.call(Client.java:1110)
              at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:226)
              at $Proxy22.getProtocolVersion(Unknown Source)
              at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:398)
              at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:384)
              at org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:111)
              at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:213)
              at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:180)
              at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:89)
              at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1514)
              at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:67)
              at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:1548)
              at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1530)
              at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:228)
              at org.apache.oozie.service.KerberosHadoopAccessorService$3.run(KerberosHadoopAccessorService.java:203)
              at org.apache.oozie.service.KerberosHadoopAccessorService$3.run(KerberosHadoopAccessorService.java:194)
              at java.security.AccessController.doPrivileged(Native Method)
              at javax.security.auth.Subject.doAs(Subject.java:396)
              at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1127)
              at org.apache.oozie.service.KerberosHadoopAccessorService.createFileSystem(KerberosHadoopAccessorService.java:194)
              ... 23 more
              Caused by: java.io.EOFException
              at java.io.DataInputStream.readInt(DataInputStream.java:375)
              at org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:815)
              at org.apache.hadoop.ipc.Client$Connection.run(Client.java:724)



              --- In Oozie-users@yahoogroups.com, Alejandro Abdelnur <tucu@...> wrote:
              >
              > Felix,
              >
              > [moving from oozie-users@ (in BCC) to cdh-user@ alias as this seems a CDH
              > setup problem]
              >
              > If you are using RPM CDH Hadoop and Oozie, you don't have to modify the
              > HadoopAccessorService.
              >
              > Everything should work out of the box with zero configuration.
              >
              > Would you try to revert to a clean install and see if you have issues there?
              >
              > Thxs.
              >
              > Alejandro
              >
              >
              >
              > On Wed, Aug 24, 2011 at 11:15 AM, Felix <felixgao@...> wrote:
              >
              > > Alejandro,
              > >
              > > I am modifying the oozie.services to
              > > <property>
              > > <name>oozie.services</name>
              > > <value>
              > > org.apache.oozie.service.SchedulerService,
              > > org.apache.oozie.service.InstrumentationService,
              > > org.apache.oozie.service.CallableQueueService,
              > > org.apache.oozie.service.UUIDService,
              > > org.apache.oozie.service.ELService,
              > > org.apache.oozie.service.AuthorizationService,
              > > org.apache.oozie.service.MemoryLocksService,
              > > org.apache.oozie.service.DagXLogInfoService,
              > > org.apache.oozie.service.SchemaService,
              > > org.apache.oozie.service.LiteWorkflowAppService,
              > > org.apache.oozie.service.StoreService,
              > > org.apache.oozie.service.CoordinatorStoreService,
              > > org.apache.oozie.service.SLAStoreService,
              > > org.apache.oozie.service.DBLiteWorkflowStoreService,
              > > org.apache.oozie.service.CallbackService,
              > > org.apache.oozie.service.ActionService,
              > > org.apache.oozie.service.ActionCheckerService,
              > > org.apache.oozie.service.RecoveryService,
              > > org.apache.oozie.service.PurgeService,
              > > org.apache.oozie.service.CoordinatorEngineService,
              > > org.apache.oozie.service.DagEngineService,
              > > org.apache.oozie.service.CoordJobMatLookupTriggerService,
              > > org.apache.oozie.service.HadoopAccessorService
              > > </value>
              > > <description>
              > > All services to be created and managed by Oozie Services
              > > singleton.
              > > Class names must be separated by commas.
              > > </description>
              > > </property>
              > >
              > > because I am seeing E0902: Exception occured: so
              > > https://github.com/yahoo/oozie/wiki/FAQ told me to add those to the xml
              > > file.
              > >
              > > --- In Oozie-users@yahoogroups.com, Alejandro Abdelnur <tucu@> wrote:
              > > >
              > > > Felix,
              > > >
              > > > What are doing that you need to modify the service classes?
              > > >
              > > > Thanks.
              > > >
              > > > Alejandro
              > > >
              > > > On Wed, Aug 24, 2011 at 9:53 AM, Felix <felixgao@> wrote:
              > > >
              > > > > NN is running on a different box and so is JT. I do have access to NN
              > > and
              > > > > JT from localhost, the box that is used for oozie used to be the
              > > launchpad
              > > > > for all of our pig jobs. When I do hadoop fs I will be able to view
              > > the
              > > > > HDFS for which ever user that I am logged in with.
              > > > >
              > > > > For my test pig I only have the following in the HDFS
              > > > > hadoop fs -ls /user/felix/oozie/workflows/test_pig
              > > > > Found 2 items
              > > > > -rw-r--r-- 2 felix supergroup 367 2011-08-23 14:28
              > > > > /user/felix/oozie/workflows/test_pig/config-default.xml
              > > > > drwxr-xr-x - felix supergroup 0 2011-08-23 14:08
              > > > > /user/felix/oozie/workflows/test_pig/lib
              > > > >
              > > > >
              > > > > The lib is empty right now.
              > > > > In my local directory I have
              > > > > ls -al
              > > > > total 28
              > > > > drwxrwxr-x 2 felix felix 4096 Aug 23 16:14 .
              > > > > drwxrwxr-x 3 felix felix 4096 Aug 23 13:07 ..
              > > > > -rw-rw-r-- 1 felix felix 367 Aug 23 14:28 config-default.xml
              > > > > -rw-rw-r-- 1 felix felix 486 Aug 23 15:56 job.properties
              > > > > -rw-rw-r-- 1 felix felix 309 Aug 23 15:02 pigexample.pig
              > > > > -rw-rw-r-- 1 felix felix 1190 Aug 23 15:41 pig-wf.xml
              > > > > -rwxrwxrwx 1 felix felix 929 Aug 23 16:09 submit.sh
              > > > >
              > > > > cat job.properties
              > > > > #The following attributes must be set
              > > > > fs.default.name=hdfs://namenode.xxx.xxx:50001
              > > > > mapred.job.tracker=jobtracker.xxx.xxx:50002
              > > > > oozie.use.system.libpath=true
              > > > > oozie.libpath=hdfs://namenode.xxx.xxx:50001/user/oozie/share/pig/lib/
              > > > > queueName=default
              > > > > #additional
              > > > >
              > > > >
              > > oozie.wf.application.path=hdfs://namenode.xxx.xxx:50001/user/felix/oozie/workflows/test_pig
              > > > > inputDir=/user/felix/test_input.data
              > > > > outputDir=/user/felix/oozie_output/pig_test
              > > > >
              > > > > I submitted the job to Oozie using
              > > > > oozie pig -oozie http://localhost:11000/oozie -file pigexample.pig
              > > -config
              > > > > job.properties
              > > > >
              > > > > hadoop we are using is 0.20.2 and oozie we are using is 2.3.0. Both are
              > > > > from cloudera's RPM.
              > > > >
              > > > > I hope this is clear enough.
              > > > >
              > > > > --- In Oozie-users@yahoogroups.com, Mohammad Islam <mislam77@> wrote:
              > > > > >
              > > > > > Do you have the NN running on the same box?
              > > > > >
              > > > > > If not, do you have the access from the localhost to NN? Did you
              > > able
              > > > > to run "haddop fs ..." command from the localhost?
              > > > > >
              > > > > >
              > > > > > Which version of hadoop and what version of oozie you are using?
              > > > > > What is the wf apppath in job.properties?
              > > > > >
              > > > > > Regards,
              > > > > > Mohammad
              > > > > >
              > > > > >
              > > > > >
              > > > > >
              > > > > > ________________________________
              > > > > > From: Felix <felixgao@>
              > > > > > To: Oozie-users@yahoogroups.com
              > > > > > Sent: Tuesday, August 23, 2011 3:28 PM
              > > > > > Subject: [Oozie-users] Oozie error when submitting jobs
              > > > > >
              > > > > >
              > > > > > Â
              > > > > > Hi all I have a simple pig job for testing that I would like to use
              > > oozie
              > > > > to manage. When I do the following I got
              > > > > >
              > > > > > oozie pig -oozie http://localhost:11000/oozie -file pigexample.pig
              > > > > -config job.properties
              > > > > > Error: E0902 : E0902: Exception occured: [java.io.IOException: Call
              > > to
              > > > > namenode/69.xxx.xxx.xxx:50001 failed on local exception:
              > > > > java.io.EOFException]
              > > > > >
              > > > > > 2011-08-23 17:18:11,861 WARN V1JobsServlet:528 - USER[felix]
              > > > > GROUP[users] TOKEN[-] APP[-] JOB[-] ACTION[-] URL[POST
              > > > > http://localhost:11000/oozie/v1/jobs?jobtype=pig] error[E0902], E0902:
              > > > > Exception occured: [java.io.IOException: Call to
              > > > > namenode/69.xxx.xxx.xxx:50001 failed on local exception:
              > > > > java.io.EOFException]
              > > > > > org.apache.oozie.servlet.XServletException: E0902: Exception occured:
              > > > > [java.io.IOException: Call to namenode/69.xxx.xxx.xxx:50001 failed on
              > > local
              > > > > exception: java.io.EOFException]
              > > > > > at
              > > > >
              > > org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.java:179)
              > > > > > at
              > > > >
              > > org.apache.oozie.servlet.BaseJobsServlet.doPost(BaseJobsServlet.java:89)
              > > > > > at javax.servlet.http.HttpServlet.service(HttpServlet.java:637)
              > > > > > at
              > > > >
              > > org.apache.oozie.servlet.JsonRestServlet.service(JsonRestServlet.java:281)
              > > > > > at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
              > > > > > at
              > > > >
              > > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
              > > > > > at
              > > > >
              > > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
              > > > > > at
              > > org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:123)
              > > > > > at
              > > > >
              > > com.cloudera.alfredo.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:371)
              > > > > > at org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:128)
              > > > > > at
              > > > >
              > > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
              > > > > > at
              > > > >
              > > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
              > > > > > at
              > > > >
              > > org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
              > > > > > at
              > > > >
              > > org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
              > > > > > at
              > > > >
              > > org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
              > > > > > at
              > > > >
              > > org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
              > > > > > at
              > > > >
              > > org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
              > > > > > at
              > > > >
              > > org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
              > > > > > at
              > > > >
              > > org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857)
              > > > > > at
              > > > >
              > > org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588)
              > > > > > at
              > > > > org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
              > > > > > at java.lang.Thread.run(Thread.java:619)
              > > > > > Caused by: org.apache.oozie.service.AuthorizationException: E0902:
              > > > > Exception occured: [java.io.IOException: Call to
              > > > > namenode/69.xxx.xxx.xxx:50001 failed on local exception:
              > > > > java.io.EOFException]
              > > > > > at
              > > > >
              > > org.apache.oozie.service.AuthorizationService.authorizeForApp(AuthorizationService.java:318)
              > > > > > at
              > > > >
              > > org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.java:171)
              > > > > > ... 21 more
              > > > > > Caused by: org.apache.oozie.service.HadoopAccessorException: E0902:
              > > > > Exception occured: [java.io.IOException: Call to
              > > > > namenode.chi.bluekai.com/69.170.130.176:50001 failed on local
              > > exception:
              > > > > java.io.EOFException]
              > > > > > at
              > > > >
              > > org.apache.oozie.service.HadoopAccessorService.createFileSystem(HadoopAccessorService.java:144)
              > > > > > at
              > > > >
              > > org.apache.oozie.service.AuthorizationService.authorizeForApp(AuthorizationService.java:283)
              > > > > > ... 22 more
              > > > > > Caused by: java.io.IOException: Call to namenode/69.xxx.xxx.xxx:50001
              > > > > failed on local exception: java.io.EOFException
              > > > > > at org.apache.hadoop.ipc.Client.wrapException(Client.java:1142)
              > > > > > at org.apache.hadoop.ipc.Client.call(Client.java:1110)
              > > > > > at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:226)
              > > > > > at $Proxy22.getProtocolVersion(Unknown Source)
              > > > > > at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:398)
              > > > > > at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:384)
              > > > > > at
              > > org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:111)
              > > > > > at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:213)
              > > > > > at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:180)
              > > > > > at
              > > > >
              > > org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:89)
              > > > > > at
              > > org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1514)
              > > > > > at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:67)
              > > > > > at
              > > > > org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:1548)
              > > > > > at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1530)
              > > > > > at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:228)
              > > > > > at
              > > > >
              > > org.apache.oozie.service.HadoopAccessorService.createFileSystem(HadoopAccessorService.java:141)
              > > > > > ... 23 more
              > > > > > Caused by: java.io.EOFException
              > > > > > at java.io.DataInputStream.readInt(DataInputStream.java:375)
              > > > > > at
              > > > >
              > > org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:815)
              > > > > > at org.apache.hadoop.ipc.Client$Connection.run(Client.java:724)
              > > > > >
              > > > > > in my oozie-site.xml I have the following services
              > > > > > <property>
              > > > > > <name>oozie.services</name>
              > > > > > <value>
              > > > > > org.apache.oozie.service.SchedulerService,
              > > > > > org.apache.oozie.service.InstrumentationService,
              > > > > > org.apache.oozie.service.CallableQueueService,
              > > > > > org.apache.oozie.service.UUIDService,
              > > > > > org.apache.oozie.service.ELService,
              > > > > > org.apache.oozie.service.AuthorizationService,
              > > > > > org.apache.oozie.service.MemoryLocksService,
              > > > > > org.apache.oozie.service.DagXLogInfoService,
              > > > > > org.apache.oozie.service.SchemaService,
              > > > > > org.apache.oozie.service.LiteWorkflowAppService,
              > > > > > org.apache.oozie.service.StoreService,
              > > > > > org.apache.oozie.service.CoordinatorStoreService,
              > > > > > org.apache.oozie.service.SLAStoreService,
              > > > > > org.apache.oozie.service.DBLiteWorkflowStoreService,
              > > > > > org.apache.oozie.service.CallbackService,
              > > > > > org.apache.oozie.service.ActionService,
              > > > > > org.apache.oozie.service.ActionCheckerService,
              > > > > > org.apache.oozie.service.RecoveryService,
              > > > > > org.apache.oozie.service.PurgeService,
              > > > > > org.apache.oozie.service.CoordinatorEngineService,
              > > > > > org.apache.oozie.service.DagEngineService,
              > > > > > org.apache.oozie.service.CoordJobMatLookupTriggerService,
              > > > > > org.apache.oozie.service.HadoopAccessorService
              > > > > > </value>
              > > > > > <description>
              > > > > > All services to be created and managed by Oozie Services singleton.
              > > > > > Class names must be separated by commas.
              > > > > > </description>
              > > > > > </property>
              > > > > >
              > > > > > if I take out org.apache.oozie.service.HadoopAccessorService, then I
              > > will
              > > > > get
              > > > > > 2011-08-23 16:09:45,587 ERROR V1JobsServlet:522 - USER[felix]
              > > > > GROUP[users] TOKEN[-] APP[-] JOB[-] ACTION[-] URL[POST
              > > > > http://localhost:11000/oozie/v1/jobs?jobtype=pig] error, null
              > > > > > java.lang.NullPointerException
              > > > > > at
              > > > >
              > > org.apache.oozie.service.AuthorizationService.authorizeForApp(AuthorizationService.java:283)
              > > > > > at
              > > > >
              > > org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.java:171)
              > > > > > at
              > > > >
              > > org.apache.oozie.servlet.BaseJobsServlet.doPost(BaseJobsServlet.java:89)
              > > > > > at javax.servlet.http.HttpServlet.service(HttpServlet.java:637)
              > > > > > at
              > > > >
              > > org.apache.oozie.servlet.JsonRestServlet.service(JsonRestServlet.java:281)
              > > > > > at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
              > > > > > at
              > > > >
              > > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
              > > > > > at
              > > > >
              > > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
              > > > > > at
              > > org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:123)
              > > > > > at
              > > > >
              > > com.cloudera.alfredo.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:371)
              > > > > > at org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:128)
              > > > > > at
              > > > >
              > > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
              > > > > > at
              > > > >
              > > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
              > > > > > at
              > > > >
              > > org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
              > > > > > at
              > > > >
              > > org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
              > > > > > at
              > > > >
              > > org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
              > > > > > at
              > > > >
              > > org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
              > > > > > at
              > > > >
              > > org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
              > > > > > at
              > > > >
              > > org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
              > > > > > at
              > > > >
              > > org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857)
              > > > > > at
              > > > >
              > > org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588)
              > > > > > at
              > > > > org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
              > > > > > at java.lang.Thread.run(Thread.java:619)
              > > > > >
              > > > > > your help is appreciated.
              > > > > >
              > > > > > Felix
              > > > > >
              > > > >
              > > > >
              > > > >
              > > > >
              > > > > ------------------------------------
              > > > >
              > > > > Yahoo! Groups Links
              > > > >
              > > > >
              > > > >
              > > > >
              > > >
              > >
              > >
              > >
              > >
              > > ------------------------------------
              > >
              > > Yahoo! Groups Links
              > >
              > >
              > >
              > >
              >
            • Alejandro Abdelnur
              Felix, [Again, moving to the cdh-user@ alias, BCCing oozie-users] What are the exact versions of Hadoop and Oozie you are using? What unix user is running
              Message 6 of 11 , Aug 24, 2011
              View Source
              • 0 Attachment
                Felix,

                [Again, moving to the cdh-user@ alias, BCCing oozie-users]

                What are the exact versions of Hadoop and Oozie you are using?

                What unix user is running Oozie server? 

                How are you starting Oozier server?

                Can you send the configuration of your Hadoop core-site.xml? I just care about the properties that have 'proxyuser' in their name.

                Thanks.

                Alejandro

                On Wed, Aug 24, 2011 at 12:01 PM, Felix <felixgao@...> wrote:
                When reverted to the stock oozie-site.xml except I have changed the database to use mysql instead of derby. I still have the exception below.

                2011-08-24 13:58:40,107  WARN V1JobsServlet:528 - USER[felix] GROUP[users] TOKEN[-] APP[-] JOB[-] ACTION[-] URL[POST http://localhost:11000/oozie/v1/jobs?jobtype=pig] error[E0902], E0902: Exception occured: [java.io.IOException: Call to namenode.xxx/69.xxx.xxx.xxx:50001 failed on local exception: java.io.EOFException]
                org.apache.oozie.servlet.XServletException: E0902: Exception occured: [java.io.IOException: Call to namenode.xxx/69.xxx.xxx.xxx:50001 failed on local exception: java.io.EOFException]
                       at org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.java:179)
                       at org.apache.oozie.servlet.BaseJobsServlet.doPost(BaseJobsServlet.java:89)
                       at javax.servlet.http.HttpServlet.service(HttpServlet.java:637)
                       at org.apache.oozie.servlet.JsonRestServlet.service(JsonRestServlet.java:281)
                       at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
                       at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
                       at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
                       at org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:123)
                       at com.cloudera.alfredo.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:371)
                       at org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:128)
                       at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
                       at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
                       at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
                       at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
                       at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
                       at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
                       at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
                       at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
                       at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857)
                       at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588)
                       at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
                       at java.lang.Thread.run(Thread.java:619)
                Caused by: org.apache.oozie.service.AuthorizationException: E0902: Exception occured: [java.io.IOException: Call to namenode.xxx/69.xxx.xxx.xxx:50001 failed on local exception: java.io.EOFException]
                       at org.apache.oozie.service.AuthorizationService.authorizeForApp(AuthorizationService.java:318)
                       at org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.java:171)
                       ... 21 more
                Caused by: org.apache.oozie.service.HadoopAccessorException: E0902: Exception occured: [java.io.IOException: Call to namenode.chi.bluekai.com/69.170.130.176:50001 failed on local exception: java.io.EOFException]
                       at org.apache.oozie.service.KerberosHadoopAccessorService.createFileSystem(KerberosHadoopAccessorService.java:211)
                       at org.apache.oozie.service.AuthorizationService.authorizeForApp(AuthorizationService.java:283)
                       ... 22 more
                Caused by: java.io.IOException: Call to namenode.xxx/69.xxx.xxx.xxx:50001 failed on local exception: java.io.EOFException
                       at org.apache.hadoop.ipc.Client.wrapException(Client.java:1142)
                       at org.apache.hadoop.ipc.Client.call(Client.java:1110)
                       at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:226)
                       at $Proxy22.getProtocolVersion(Unknown Source)
                       at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:398)
                       at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:384)
                       at org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:111)
                       at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:213)
                       at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:180)
                       at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:89)
                       at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1514)
                       at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:67)
                       at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:1548)
                       at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1530)
                       at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:228)
                       at org.apache.oozie.service.KerberosHadoopAccessorService$3.run(KerberosHadoopAccessorService.java:203)
                       at org.apache.oozie.service.KerberosHadoopAccessorService$3.run(KerberosHadoopAccessorService.java:194)
                       at java.security.AccessController.doPrivileged(Native Method)
                       at javax.security.auth.Subject.doAs(Subject.java:396)
                       at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1127)
                       at org.apache.oozie.service.KerberosHadoopAccessorService.createFileSystem(KerberosHadoopAccessorService.java:194)
                       ... 23 more
                Caused by: java.io.EOFException
                       at java.io.DataInputStream.readInt(DataInputStream.java:375)
                       at org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:815)
                       at org.apache.hadoop.ipc.Client$Connection.run(Client.java:724)



                --- In Oozie-users@yahoogroups.com, Alejandro Abdelnur <tucu@...> wrote:
                >
                > Felix,
                >
                > [moving from oozie-users@  (in BCC) to cdh-user@ alias as this seems a CDH
                > setup  problem]
                >
                > If you are using RPM CDH Hadoop and Oozie, you don't have to modify the
                > HadoopAccessorService.
                >
                > Everything should work out of the box with zero configuration.
                >
                > Would you try to revert to a clean install and see if you have issues there?
                >
                > Thxs.
                >
                > Alejandro
                >
                >
                >
                > On Wed, Aug 24, 2011 at 11:15 AM, Felix <felixgao@...> wrote:
                >
                > > Alejandro,
                > >
                > > I am modifying the oozie.services to
                > > <property>
                > >        <name>oozie.services</name>
                > >        <value>
                > >            org.apache.oozie.service.SchedulerService,
                > >            org.apache.oozie.service.InstrumentationService,
                > >            org.apache.oozie.service.CallableQueueService,
                > >            org.apache.oozie.service.UUIDService,
                > >            org.apache.oozie.service.ELService,
                > >            org.apache.oozie.service.AuthorizationService,
                > >            org.apache.oozie.service.MemoryLocksService,
                > >            org.apache.oozie.service.DagXLogInfoService,
                > >            org.apache.oozie.service.SchemaService,
                > >            org.apache.oozie.service.LiteWorkflowAppService,
                > >            org.apache.oozie.service.StoreService,
                > >            org.apache.oozie.service.CoordinatorStoreService,
                > >            org.apache.oozie.service.SLAStoreService,
                > >            org.apache.oozie.service.DBLiteWorkflowStoreService,
                > >            org.apache.oozie.service.CallbackService,
                > >            org.apache.oozie.service.ActionService,
                > >            org.apache.oozie.service.ActionCheckerService,
                > >            org.apache.oozie.service.RecoveryService,
                > >            org.apache.oozie.service.PurgeService,
                > >            org.apache.oozie.service.CoordinatorEngineService,
                > >            org.apache.oozie.service.DagEngineService,
                > >            org.apache.oozie.service.CoordJobMatLookupTriggerService,
                > >            org.apache.oozie.service.HadoopAccessorService
                > >        </value>
                > >        <description>
                > >            All services to be created and managed by Oozie Services
                > > singleton.
                > >            Class names must be separated by commas.
                > >        </description>
                > >    </property>
                > >
                > > because I am seeing E0902: Exception occured:  so
                > > https://github.com/yahoo/oozie/wiki/FAQ told me to add those to the xml
                > > file.
                > >
                > > --- In Oozie-users@yahoogroups.com, Alejandro Abdelnur <tucu@> wrote:
                > > >
                > > > Felix,
                > > >
                > > > What are doing that you need to modify the service classes?
                > > >
                > > > Thanks.
                > > >
                > > > Alejandro
                > > >
                > > > On Wed, Aug 24, 2011 at 9:53 AM, Felix <felixgao@> wrote:
                > > >
                > > > > NN is running on a different box and so is JT. I do have access to NN
                > > and
                > > > > JT from localhost, the box that is used for oozie used to be the
                > > launchpad
                > > > > for all of our pig jobs.  When I do hadoop fs I will be able to view
                > > the
                > > > > HDFS for which ever user that I am logged in with.
                > > > >
                > > > > For my test pig I only have the following in the HDFS
                > > > > hadoop fs -ls /user/felix/oozie/workflows/test_pig
                > > > > Found 2 items
                > > > > -rw-r--r--   2 felix supergroup        367 2011-08-23 14:28
                > > > > /user/felix/oozie/workflows/test_pig/config-default.xml
                > > > > drwxr-xr-x   - felix supergroup          0 2011-08-23 14:08
                > > > > /user/felix/oozie/workflows/test_pig/lib
                > > > >
                > > > >
                > > > > The lib is empty right now.
                > > > > In my local directory I have
                > > > > ls -al
                > > > > total 28
                > > > > drwxrwxr-x 2 felix felix 4096 Aug 23 16:14 .
                > > > > drwxrwxr-x 3 felix felix 4096 Aug 23 13:07 ..
                > > > > -rw-rw-r-- 1 felix felix  367 Aug 23 14:28 config-default.xml
                > > > > -rw-rw-r-- 1 felix felix  486 Aug 23 15:56 job.properties
                > > > > -rw-rw-r-- 1 felix felix  309 Aug 23 15:02 pigexample.pig
                > > > > -rw-rw-r-- 1 felix felix 1190 Aug 23 15:41 pig-wf.xml
                > > > > -rwxrwxrwx 1 felix felix  929 Aug 23 16:09 submit.sh
                > > > >
                > > > >  cat job.properties
                > > > > #The following attributes must be set
                > > > > fs.default.name=hdfs://namenode.xxx.xxx:50001
                > > > > mapred.job.tracker=jobtracker.xxx.xxx:50002
                > > > > oozie.use.system.libpath=true
                > > > > oozie.libpath=hdfs://namenode.xxx.xxx:50001/user/oozie/share/pig/lib/
                > > > > queueName=default
                > > > > #additional
                > > > >
                > > > >
                > > oozie.wf.application.path=hdfs://namenode.xxx.xxx:50001/user/felix/oozie/workflows/test_pig
                > > > > inputDir=/user/felix/test_input.data
                > > > > outputDir=/user/felix/oozie_output/pig_test
                > > > >
                > > > > I submitted the job to Oozie using
                > > > > oozie pig -oozie http://localhost:11000/oozie -file pigexample.pig
                > > -config
                > > > > job.properties
                > > > >
                > > > > hadoop we are using is 0.20.2 and oozie we are using is 2.3.0. Both are
                > > > > from cloudera's RPM.
                > > > >
                > > > > I hope this is clear enough.
                > > > >
                > > > > --- In Oozie-users@yahoogroups.com, Mohammad Islam <mislam77@> wrote:
                > > > > >
                > > > > > Do you have the NN running on the same box?
                > > > > >
                > > > > > If not,  do you have the access from the localhost to NN? Did you
                > > able
                > > > > to run "haddop fs ..." command from the localhost?
                > > > > >
                > > > > >
                > > > > > Which version of hadoop and what version of oozie you are using?
                > > > > > What is the wf apppath in job.properties?
                > > > > >
                > > > > > Regards,
                > > > > > Mohammad
                > > > > >
                > > > > >
                > > > > >
                > > > > >
                > > > > > ________________________________
                > > > > > From: Felix <felixgao@>
                > > > > > To: Oozie-users@yahoogroups.com
                > > > > > Sent: Tuesday, August 23, 2011 3:28 PM
                > > > > > Subject: [Oozie-users] Oozie error when submitting jobs
                > > > > >
                > > > > >
                > > > > > Â
                > > > > > Hi all I have a simple pig job for testing that I would like to use
                > > oozie
                > > > > to manage.  When I do the following I got
                > > > > >
                > > > > > oozie pig -oozie http://localhost:11000/oozie -file pigexample.pig
                > > > > -config job.properties
                > > > > > Error: E0902 : E0902: Exception occured: [java.io.IOException: Call
                > > to
                > > > > namenode/69.xxx.xxx.xxx:50001 failed on local exception:
                > > > > java.io.EOFException]
                > > > > >
                > > > > > 2011-08-23 17:18:11,861  WARN V1JobsServlet:528 - USER[felix]
                > > > > GROUP[users] TOKEN[-] APP[-] JOB[-] ACTION[-] URL[POST
                > > > > http://localhost:11000/oozie/v1/jobs?jobtype=pig] error[E0902], E0902:
                > > > > Exception occured: [java.io.IOException: Call to
                > > > > namenode/69.xxx.xxx.xxx:50001 failed on local exception:
                > > > > java.io.EOFException]
                > > > > > org.apache.oozie.servlet.XServletException: E0902: Exception occured:
                > > > > [java.io.IOException: Call to namenode/69.xxx.xxx.xxx:50001 failed on
                > > local
                > > > > exception: java.io.EOFException]
                > > > > > at
                > > > >
                > > org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.java:179)
                > > > > > at
                > > > >
                > > org.apache.oozie.servlet.BaseJobsServlet.doPost(BaseJobsServlet.java:89)
                > > > > > at javax.servlet.http.HttpServlet.service(HttpServlet.java:637)
                > > > > > at
                > > > >
                > > org.apache.oozie.servlet.JsonRestServlet.service(JsonRestServlet.java:281)
                > > > > > at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
                > > > > > at
                > > > >
                > > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
                > > > > > at
                > > > >
                > > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
                > > > > > at
                > > org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:123)
                > > > > > at
                > > > >
                > > com.cloudera.alfredo.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:371)
                > > > > > at org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:128)
                > > > > > at
                > > > >
                > > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
                > > > > > at
                > > > >
                > > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
                > > > > > at
                > > > >
                > > org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
                > > > > > at
                > > > >
                > > org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
                > > > > > at
                > > > >
                > > org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
                > > > > > at
                > > > >
                > > org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
                > > > > > at
                > > > >
                > > org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
                > > > > > at
                > > > >
                > > org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
                > > > > > at
                > > > >
                > > org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857)
                > > > > > at
                > > > >
                > > org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588)
                > > > > > at
                > > > > org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
                > > > > > at java.lang.Thread.run(Thread.java:619)
                > > > > > Caused by: org.apache.oozie.service.AuthorizationException: E0902:
                > > > > Exception occured: [java.io.IOException: Call to
                > > > > namenode/69.xxx.xxx.xxx:50001 failed on local exception:
                > > > > java.io.EOFException]
                > > > > > at
                > > > >
                > > org.apache.oozie.service.AuthorizationService.authorizeForApp(AuthorizationService.java:318)
                > > > > > at
                > > > >
                > > org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.java:171)
                > > > > > ... 21 more
                > > > > > Caused by: org.apache.oozie.service.HadoopAccessorException: E0902:
                > > > > Exception occured: [java.io.IOException: Call to
                > > > > namenode.chi.bluekai.com/69.170.130.176:50001 failed on local
                > > exception:
                > > > > java.io.EOFException]
                > > > > > at
                > > > >
                > > org.apache.oozie.service.HadoopAccessorService.createFileSystem(HadoopAccessorService.java:144)
                > > > > > at
                > > > >
                > > org.apache.oozie.service.AuthorizationService.authorizeForApp(AuthorizationService.java:283)
                > > > > > ... 22 more
                > > > > > Caused by: java.io.IOException: Call to namenode/69.xxx.xxx.xxx:50001
                > > > > failed on local exception: java.io.EOFException
                > > > > > at org.apache.hadoop.ipc.Client.wrapException(Client.java:1142)
                > > > > > at org.apache.hadoop.ipc.Client.call(Client.java:1110)
                > > > > > at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:226)
                > > > > > at $Proxy22.getProtocolVersion(Unknown Source)
                > > > > > at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:398)
                > > > > > at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:384)
                > > > > > at
                > > org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:111)
                > > > > > at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:213)
                > > > > > at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:180)
                > > > > > at
                > > > >
                > > org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:89)
                > > > > > at
                > > org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1514)
                > > > > > at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:67)
                > > > > > at
                > > > > org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:1548)
                > > > > > at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1530)
                > > > > > at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:228)
                > > > > > at
                > > > >
                > > org.apache.oozie.service.HadoopAccessorService.createFileSystem(HadoopAccessorService.java:141)
                > > > > > ... 23 more
                > > > > > Caused by: java.io.EOFException
                > > > > > at java.io.DataInputStream.readInt(DataInputStream.java:375)
                > > > > > at
                > > > >
                > > org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:815)
                > > > > > at org.apache.hadoop.ipc.Client$Connection.run(Client.java:724)
                > > > > >
                > > > > > in my oozie-site.xml I have the following services
                > > > > > <property>
                > > > > > <name>oozie.services</name>
                > > > > > <value>
                > > > > > org.apache.oozie.service.SchedulerService,
                > > > > > org.apache.oozie.service.InstrumentationService,
                > > > > > org.apache.oozie.service.CallableQueueService,
                > > > > > org.apache.oozie.service.UUIDService,
                > > > > > org.apache.oozie.service.ELService,
                > > > > > org.apache.oozie.service.AuthorizationService,
                > > > > > org.apache.oozie.service.MemoryLocksService,
                > > > > > org.apache.oozie.service.DagXLogInfoService,
                > > > > > org.apache.oozie.service.SchemaService,
                > > > > > org.apache.oozie.service.LiteWorkflowAppService,
                > > > > > org.apache.oozie.service.StoreService,
                > > > > > org.apache.oozie.service.CoordinatorStoreService,
                > > > > > org.apache.oozie.service.SLAStoreService,
                > > > > > org.apache.oozie.service.DBLiteWorkflowStoreService,
                > > > > > org.apache.oozie.service.CallbackService,
                > > > > > org.apache.oozie.service.ActionService,
                > > > > > org.apache.oozie.service.ActionCheckerService,
                > > > > > org.apache.oozie.service.RecoveryService,
                > > > > > org.apache.oozie.service.PurgeService,
                > > > > > org.apache.oozie.service.CoordinatorEngineService,
                > > > > > org.apache.oozie.service.DagEngineService,
                > > > > > org.apache.oozie.service.CoordJobMatLookupTriggerService,
                > > > > > org.apache.oozie.service.HadoopAccessorService
                > > > > > </value>
                > > > > > <description>
                > > > > > All services to be created and managed by Oozie Services singleton.
                > > > > > Class names must be separated by commas.
                > > > > > </description>
                > > > > > </property>
                > > > > >
                > > > > > if I take out org.apache.oozie.service.HadoopAccessorService, then I
                > > will
                > > > > get
                > > > > > 2011-08-23 16:09:45,587 ERROR V1JobsServlet:522 - USER[felix]
                > > > > GROUP[users] TOKEN[-] APP[-] JOB[-] ACTION[-] URL[POST
                > > > > http://localhost:11000/oozie/v1/jobs?jobtype=pig] error, null
                > > > > > java.lang.NullPointerException
                > > > > > at
                > > > >
                > > org.apache.oozie.service.AuthorizationService.authorizeForApp(AuthorizationService.java:283)
                > > > > > at
                > > > >
                > > org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.java:171)
                > > > > > at
                > > > >
                > > org.apache.oozie.servlet.BaseJobsServlet.doPost(BaseJobsServlet.java:89)
                > > > > > at javax.servlet.http.HttpServlet.service(HttpServlet.java:637)
                > > > > > at
                > > > >
                > > org.apache.oozie.servlet.JsonRestServlet.service(JsonRestServlet.java:281)
                > > > > > at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
                > > > > > at
                > > > >
                > > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
                > > > > > at
                > > > >
                > > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
                > > > > > at
                > > org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:123)
                > > > > > at
                > > > >
                > > com.cloudera.alfredo.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:371)
                > > > > > at org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:128)
                > > > > > at
                > > > >
                > > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
                > > > > > at
                > > > >
                > > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
                > > > > > at
                > > > >
                > > org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
                > > > > > at
                > > > >
                > > org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
                > > > > > at
                > > > >
                > > org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
                > > > > > at
                > > > >
                > > org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
                > > > > > at
                > > > >
                > > org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
                > > > > > at
                > > > >
                > > org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
                > > > > > at
                > > > >
                > > org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857)
                > > > > > at
                > > > >
                > > org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588)
                > > > > > at
                > > > > org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
                > > > > > at java.lang.Thread.run(Thread.java:619)
                > > > > >
                > > > > > your help is appreciated.
                > > > > >
                > > > > > Felix
                > > > > >
                > > > >
                > > > >
                > > > >
                > > > >
                > > > > ------------------------------------
                > > > >
                > > > > Yahoo! Groups Links
                > > > >
                > > > >
                > > > >
                > > > >
                > > >
                > >
                > >
                > >
                > >
                > > ------------------------------------
                > >
                > > Yahoo! Groups Links
                > >
                > >
                > >
                > >
                >




                ------------------------------------

                Yahoo! Groups Links

                <*> To visit your group on the web, go to:
                   http://groups.yahoo.com/group/Oozie-users/

                <*> Your email settings:
                   Individual Email | Traditional

                <*> To change settings online go to:
                   http://groups.yahoo.com/group/Oozie-users/join
                   (Yahoo! ID required)

                <*> To change settings via email:
                   Oozie-users-digest@yahoogroups.com
                   Oozie-users-fullfeatured@yahoogroups.com

                <*> To unsubscribe from this group, send an email to:
                   Oozie-users-unsubscribe@yahoogroups.com

                <*> Your use of Yahoo! Groups is subject to:
                   http://docs.yahoo.com/info/terms/


              • Felix
                hadoop version Hadoop 0.20.2+228 Subversion -r cfc3233ece0769b11af9add328261295aaf4d1ad Compiled by root on Mon Mar 22 03:11:39 EDT 2010 oozie version Oozie
                Message 7 of 11 , Aug 24, 2011
                View Source
                • 0 Attachment
                  hadoop version
                  Hadoop 0.20.2+228
                  Subversion -r cfc3233ece0769b11af9add328261295aaf4d1ad
                  Compiled by root on Mon Mar 22 03:11:39 EDT 2010

                  oozie version
                  Oozie client build version: 2.3.0-cdh3u1

                  oozie is running as oozie
                  oozie 26991 1 0 13:57 ? 00:00:07 /usr/bin/java -Djava.util.logging.config.file=/var/lib/oozie/oozie-server/conf/logging.properties -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager -Dderby.stream.error.file=/var/log/oozie/derby.log -Doozie.home.dir=/usr/lib/oozie -Doozie.config.dir=/etc/oozie -Doozie.log.dir=/var/log/oozie -Doozie.data.dir=/var/lib/oozie -Doozie.config.file=oozie-site.xml -Doozie.log4j.file=oozie-log4j.properties -Doozie.log4j.reload=10 -Doozie.http.hostname=sumo.chi.bluekai.com -Doozie.http.port=11000 -Doozie.base.url=http://localhost:11000/oozie -Djava.endorsed.dirs=/usr/lib/oozie/oozie-server/endorsed -classpath /usr/lib/oozie/oozie-server/bin/bootstrap.jar -Dcatalina.base=/var/lib/oozie/oozie-server -Dcatalina.home=/usr/lib/oozie/oozie-server -Djava.io.tmpdir=/var/tmp/oozie org.apache.catalina.startup.Bootstrap start

                  OS is centos 5.5 2.6.18-164.15.1.el5 #1 SMP Wed Mar 17 11:30:06 EDT 2010 x86_64 x86_64 x86_64 GNU/Linux

                  There isn't any entry in proxyuser at the core-site.xml

                  Felix



                  --- In Oozie-users@yahoogroups.com, Alejandro Abdelnur <tucu@...> wrote:
                  >
                  > Felix,
                  >
                  > [Again, moving to the cdh-user@ alias, BCCing oozie-users]
                  >
                  > What are the exact versions of Hadoop and Oozie you are using?
                  >
                  > What unix user is running Oozie server?
                  >
                  > How are you starting Oozier server?
                  >
                  > Can you send the configuration of your Hadoop core-site.xml? I just care
                  > about the properties that have 'proxyuser' in their name.
                  >
                  > Thanks.
                  >
                  > Alejandro
                  >
                  > On Wed, Aug 24, 2011 at 12:01 PM, Felix <felixgao@...> wrote:
                  >
                  > > When reverted to the stock oozie-site.xml except I have changed the
                  > > database to use mysql instead of derby. I still have the exception below.
                  > >
                  > > 2011-08-24 13:58:40,107 WARN V1JobsServlet:528 - USER[felix] GROUP[users]
                  > > TOKEN[-] APP[-] JOB[-] ACTION[-] URL[POST
                  > > http://localhost:11000/oozie/v1/jobs?jobtype=pig] error[E0902], E0902:
                  > > Exception occured: [java.io.IOException: Call to
                  > > namenode.xxx/69.xxx.xxx.xxx:50001 failed on local exception:
                  > > java.io.EOFException]
                  > > org.apache.oozie.servlet.XServletException: E0902: Exception occured:
                  > > [java.io.IOException: Call to namenode.xxx/69.xxx.xxx.xxx:50001 failed on
                  > > local exception: java.io.EOFException]
                  > > at
                  > > org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.java:179)
                  > > at
                  > > org.apache.oozie.servlet.BaseJobsServlet.doPost(BaseJobsServlet.java:89)
                  > > at javax.servlet.http.HttpServlet.service(HttpServlet.java:637)
                  > > at
                  > > org.apache.oozie.servlet.JsonRestServlet.service(JsonRestServlet.java:281)
                  > > at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
                  > > at
                  > > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
                  > > at
                  > > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
                  > > at
                  > > org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:123)
                  > > at
                  > > com.cloudera.alfredo.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:371)
                  > > at org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:128)
                  > > at
                  > > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
                  > > at
                  > > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
                  > > at
                  > > org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
                  > > at
                  > > org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
                  > > at
                  > > org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
                  > > at
                  > > org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
                  > > at
                  > > org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
                  > > at
                  > > org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
                  > > at
                  > > org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857)
                  > > at
                  > > org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588)
                  > > at
                  > > org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
                  > > at java.lang.Thread.run(Thread.java:619)
                  > > Caused by: org.apache.oozie.service.AuthorizationException: E0902:
                  > > Exception occured: [java.io.IOException: Call to
                  > > namenode.xxx/69.xxx.xxx.xxx:50001 failed on local exception:
                  > > java.io.EOFException]
                  > > at
                  > > org.apache.oozie.service.AuthorizationService.authorizeForApp(AuthorizationService.java:318)
                  > > at
                  > > org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.java:171)
                  > > ... 21 more
                  > > Caused by: org.apache.oozie.service.HadoopAccessorException: E0902:
                  > > Exception occured: [java.io.IOException: Call to
                  > > namenode.chi.bluekai.com/69.170.130.176:50001 failed on local exception:
                  > > java.io.EOFException]
                  > > at
                  > > org.apache.oozie.service.KerberosHadoopAccessorService.createFileSystem(KerberosHadoopAccessorService.java:211)
                  > > at
                  > > org.apache.oozie.service.AuthorizationService.authorizeForApp(AuthorizationService.java:283)
                  > > ... 22 more
                  > > Caused by: java.io.IOException: Call to namenode.xxx/69.xxx.xxx.xxx:50001
                  > > failed on local exception: java.io.EOFException
                  > > at org.apache.hadoop.ipc.Client.wrapException(Client.java:1142)
                  > > at org.apache.hadoop.ipc.Client.call(Client.java:1110)
                  > > at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:226)
                  > > at $Proxy22.getProtocolVersion(Unknown Source)
                  > > at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:398)
                  > > at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:384)
                  > > at
                  > > org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:111)
                  > > at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:213)
                  > > at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:180)
                  > > at
                  > > org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:89)
                  > > at
                  > > org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1514)
                  > > at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:67)
                  > > at
                  > > org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:1548)
                  > > at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1530)
                  > > at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:228)
                  > > at
                  > > org.apache.oozie.service.KerberosHadoopAccessorService$3.run(KerberosHadoopAccessorService.java:203)
                  > > at
                  > > org.apache.oozie.service.KerberosHadoopAccessorService$3.run(KerberosHadoopAccessorService.java:194)
                  > > at java.security.AccessController.doPrivileged(Native Method)
                  > > at javax.security.auth.Subject.doAs(Subject.java:396)
                  > > at
                  > > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1127)
                  > > at
                  > > org.apache.oozie.service.KerberosHadoopAccessorService.createFileSystem(KerberosHadoopAccessorService.java:194)
                  > > ... 23 more
                  > > Caused by: java.io.EOFException
                  > > at java.io.DataInputStream.readInt(DataInputStream.java:375)
                  > > at
                  > > org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:815)
                  > > at org.apache.hadoop.ipc.Client$Connection.run(Client.java:724)
                  > >
                  > >
                  > >
                  > > --- In Oozie-users@yahoogroups.com, Alejandro Abdelnur <tucu@> wrote:
                  > > >
                  > > > Felix,
                  > > >
                  > > > [moving from oozie-users@ (in BCC) to cdh-user@ alias as this seems a
                  > > CDH
                  > > > setup problem]
                  > > >
                  > > > If you are using RPM CDH Hadoop and Oozie, you don't have to modify the
                  > > > HadoopAccessorService.
                  > > >
                  > > > Everything should work out of the box with zero configuration.
                  > > >
                  > > > Would you try to revert to a clean install and see if you have issues
                  > > there?
                  > > >
                  > > > Thxs.
                  > > >
                  > > > Alejandro
                  > > >
                  > > >
                  > > >
                  > > > On Wed, Aug 24, 2011 at 11:15 AM, Felix <felixgao@> wrote:
                  > > >
                  > > > > Alejandro,
                  > > > >
                  > > > > I am modifying the oozie.services to
                  > > > > <property>
                  > > > > <name>oozie.services</name>
                  > > > > <value>
                  > > > > org.apache.oozie.service.SchedulerService,
                  > > > > org.apache.oozie.service.InstrumentationService,
                  > > > > org.apache.oozie.service.CallableQueueService,
                  > > > > org.apache.oozie.service.UUIDService,
                  > > > > org.apache.oozie.service.ELService,
                  > > > > org.apache.oozie.service.AuthorizationService,
                  > > > > org.apache.oozie.service.MemoryLocksService,
                  > > > > org.apache.oozie.service.DagXLogInfoService,
                  > > > > org.apache.oozie.service.SchemaService,
                  > > > > org.apache.oozie.service.LiteWorkflowAppService,
                  > > > > org.apache.oozie.service.StoreService,
                  > > > > org.apache.oozie.service.CoordinatorStoreService,
                  > > > > org.apache.oozie.service.SLAStoreService,
                  > > > > org.apache.oozie.service.DBLiteWorkflowStoreService,
                  > > > > org.apache.oozie.service.CallbackService,
                  > > > > org.apache.oozie.service.ActionService,
                  > > > > org.apache.oozie.service.ActionCheckerService,
                  > > > > org.apache.oozie.service.RecoveryService,
                  > > > > org.apache.oozie.service.PurgeService,
                  > > > > org.apache.oozie.service.CoordinatorEngineService,
                  > > > > org.apache.oozie.service.DagEngineService,
                  > > > > org.apache.oozie.service.CoordJobMatLookupTriggerService,
                  > > > > org.apache.oozie.service.HadoopAccessorService
                  > > > > </value>
                  > > > > <description>
                  > > > > All services to be created and managed by Oozie Services
                  > > > > singleton.
                  > > > > Class names must be separated by commas.
                  > > > > </description>
                  > > > > </property>
                  > > > >
                  > > > > because I am seeing E0902: Exception occured: so
                  > > > > https://github.com/yahoo/oozie/wiki/FAQ told me to add those to the
                  > > xml
                  > > > > file.
                  > > > >
                  > > > > --- In Oozie-users@yahoogroups.com, Alejandro Abdelnur <tucu@> wrote:
                  > > > > >
                  > > > > > Felix,
                  > > > > >
                  > > > > > What are doing that you need to modify the service classes?
                  > > > > >
                  > > > > > Thanks.
                  > > > > >
                  > > > > > Alejandro
                  > > > > >
                  > > > > > On Wed, Aug 24, 2011 at 9:53 AM, Felix <felixgao@> wrote:
                  > > > > >
                  > > > > > > NN is running on a different box and so is JT. I do have access to
                  > > NN
                  > > > > and
                  > > > > > > JT from localhost, the box that is used for oozie used to be the
                  > > > > launchpad
                  > > > > > > for all of our pig jobs. When I do hadoop fs I will be able to
                  > > view
                  > > > > the
                  > > > > > > HDFS for which ever user that I am logged in with.
                  > > > > > >
                  > > > > > > For my test pig I only have the following in the HDFS
                  > > > > > > hadoop fs -ls /user/felix/oozie/workflows/test_pig
                  > > > > > > Found 2 items
                  > > > > > > -rw-r--r-- 2 felix supergroup 367 2011-08-23 14:28
                  > > > > > > /user/felix/oozie/workflows/test_pig/config-default.xml
                  > > > > > > drwxr-xr-x - felix supergroup 0 2011-08-23 14:08
                  > > > > > > /user/felix/oozie/workflows/test_pig/lib
                  > > > > > >
                  > > > > > >
                  > > > > > > The lib is empty right now.
                  > > > > > > In my local directory I have
                  > > > > > > ls -al
                  > > > > > > total 28
                  > > > > > > drwxrwxr-x 2 felix felix 4096 Aug 23 16:14 .
                  > > > > > > drwxrwxr-x 3 felix felix 4096 Aug 23 13:07 ..
                  > > > > > > -rw-rw-r-- 1 felix felix 367 Aug 23 14:28 config-default.xml
                  > > > > > > -rw-rw-r-- 1 felix felix 486 Aug 23 15:56 job.properties
                  > > > > > > -rw-rw-r-- 1 felix felix 309 Aug 23 15:02 pigexample.pig
                  > > > > > > -rw-rw-r-- 1 felix felix 1190 Aug 23 15:41 pig-wf.xml
                  > > > > > > -rwxrwxrwx 1 felix felix 929 Aug 23 16:09 submit.sh
                  > > > > > >
                  > > > > > > cat job.properties
                  > > > > > > #The following attributes must be set
                  > > > > > > fs.default.name=hdfs://namenode.xxx.xxx:50001
                  > > > > > > mapred.job.tracker=jobtracker.xxx.xxx:50002
                  > > > > > > oozie.use.system.libpath=true
                  > > > > > >
                  > > oozie.libpath=hdfs://namenode.xxx.xxx:50001/user/oozie/share/pig/lib/
                  > > > > > > queueName=default
                  > > > > > > #additional
                  > > > > > >
                  > > > > > >
                  > > > >
                  > > oozie.wf.application.path=hdfs://namenode.xxx.xxx:50001/user/felix/oozie/workflows/test_pig
                  > > > > > > inputDir=/user/felix/test_input.data
                  > > > > > > outputDir=/user/felix/oozie_output/pig_test
                  > > > > > >
                  > > > > > > I submitted the job to Oozie using
                  > > > > > > oozie pig -oozie http://localhost:11000/oozie -file pigexample.pig
                  > > > > -config
                  > > > > > > job.properties
                  > > > > > >
                  > > > > > > hadoop we are using is 0.20.2 and oozie we are using is 2.3.0. Both
                  > > are
                  > > > > > > from cloudera's RPM.
                  > > > > > >
                  > > > > > > I hope this is clear enough.
                  > > > > > >
                  > > > > > > --- In Oozie-users@yahoogroups.com, Mohammad Islam <mislam77@>
                  > > wrote:
                  > > > > > > >
                  > > > > > > > Do you have the NN running on the same box?
                  > > > > > > >
                  > > > > > > > If not, do you have the access from the localhost to NN? Did
                  > > you
                  > > > > able
                  > > > > > > to run "haddop fs ..." command from the localhost?
                  > > > > > > >
                  > > > > > > >
                  > > > > > > > Which version of hadoop and what version of oozie you are using?
                  > > > > > > > What is the wf apppath in job.properties?
                  > > > > > > >
                  > > > > > > > Regards,
                  > > > > > > > Mohammad
                  > > > > > > >
                  > > > > > > >
                  > > > > > > >
                  > > > > > > >
                  > > > > > > > ________________________________
                  > > > > > > > From: Felix <felixgao@>
                  > > > > > > > To: Oozie-users@yahoogroups.com
                  > > > > > > > Sent: Tuesday, August 23, 2011 3:28 PM
                  > > > > > > > Subject: [Oozie-users] Oozie error when submitting jobs
                  > > > > > > >
                  > > > > > > >
                  > > > > > > > Â
                  > > > > > > > Hi all I have a simple pig job for testing that I would like to
                  > > use
                  > > > > oozie
                  > > > > > > to manage. When I do the following I got
                  > > > > > > >
                  > > > > > > > oozie pig -oozie http://localhost:11000/oozie -file
                  > > pigexample.pig
                  > > > > > > -config job.properties
                  > > > > > > > Error: E0902 : E0902: Exception occured: [java.io.IOException:
                  > > Call
                  > > > > to
                  > > > > > > namenode/69.xxx.xxx.xxx:50001 failed on local exception:
                  > > > > > > java.io.EOFException]
                  > > > > > > >
                  > > > > > > > 2011-08-23 17:18:11,861 WARN V1JobsServlet:528 - USER[felix]
                  > > > > > > GROUP[users] TOKEN[-] APP[-] JOB[-] ACTION[-] URL[POST
                  > > > > > > http://localhost:11000/oozie/v1/jobs?jobtype=pig] error[E0902],
                  > > E0902:
                  > > > > > > Exception occured: [java.io.IOException: Call to
                  > > > > > > namenode/69.xxx.xxx.xxx:50001 failed on local exception:
                  > > > > > > java.io.EOFException]
                  > > > > > > > org.apache.oozie.servlet.XServletException: E0902: Exception
                  > > occured:
                  > > > > > > [java.io.IOException: Call to namenode/69.xxx.xxx.xxx:50001 failed
                  > > on
                  > > > > local
                  > > > > > > exception: java.io.EOFException]
                  > > > > > > > at
                  > > > > > >
                  > > > >
                  > > org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.java:179)
                  > > > > > > > at
                  > > > > > >
                  > > > >
                  > > org.apache.oozie.servlet.BaseJobsServlet.doPost(BaseJobsServlet.java:89)
                  > > > > > > > at javax.servlet.http.HttpServlet.service(HttpServlet.java:637)
                  > > > > > > > at
                  > > > > > >
                  > > > >
                  > > org.apache.oozie.servlet.JsonRestServlet.service(JsonRestServlet.java:281)
                  > > > > > > > at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
                  > > > > > > > at
                  > > > > > >
                  > > > >
                  > > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
                  > > > > > > > at
                  > > > > > >
                  > > > >
                  > > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
                  > > > > > > > at
                  > > > > org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:123)
                  > > > > > > > at
                  > > > > > >
                  > > > >
                  > > com.cloudera.alfredo.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:371)
                  > > > > > > > at
                  > > org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:128)
                  > > > > > > > at
                  > > > > > >
                  > > > >
                  > > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
                  > > > > > > > at
                  > > > > > >
                  > > > >
                  > > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
                  > > > > > > > at
                  > > > > > >
                  > > > >
                  > > org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
                  > > > > > > > at
                  > > > > > >
                  > > > >
                  > > org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
                  > > > > > > > at
                  > > > > > >
                  > > > >
                  > > org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
                  > > > > > > > at
                  > > > > > >
                  > > > >
                  > > org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
                  > > > > > > > at
                  > > > > > >
                  > > > >
                  > > org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
                  > > > > > > > at
                  > > > > > >
                  > > > >
                  > > org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
                  > > > > > > > at
                  > > > > > >
                  > > > >
                  > > org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857)
                  > > > > > > > at
                  > > > > > >
                  > > > >
                  > > org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588)
                  > > > > > > > at
                  > > > > > >
                  > > org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
                  > > > > > > > at java.lang.Thread.run(Thread.java:619)
                  > > > > > > > Caused by: org.apache.oozie.service.AuthorizationException:
                  > > E0902:
                  > > > > > > Exception occured: [java.io.IOException: Call to
                  > > > > > > namenode/69.xxx.xxx.xxx:50001 failed on local exception:
                  > > > > > > java.io.EOFException]
                  > > > > > > > at
                  > > > > > >
                  > > > >
                  > > org.apache.oozie.service.AuthorizationService.authorizeForApp(AuthorizationService.java:318)
                  > > > > > > > at
                  > > > > > >
                  > > > >
                  > > org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.java:171)
                  > > > > > > > ... 21 more
                  > > > > > > > Caused by: org.apache.oozie.service.HadoopAccessorException:
                  > > E0902:
                  > > > > > > Exception occured: [java.io.IOException: Call to
                  > > > > > > namenode.chi.bluekai.com/69.170.130.176:50001 failed on local
                  > > > > exception:
                  > > > > > > java.io.EOFException]
                  > > > > > > > at
                  > > > > > >
                  > > > >
                  > > org.apache.oozie.service.HadoopAccessorService.createFileSystem(HadoopAccessorService.java:144)
                  > > > > > > > at
                  > > > > > >
                  > > > >
                  > > org.apache.oozie.service.AuthorizationService.authorizeForApp(AuthorizationService.java:283)
                  > > > > > > > ... 22 more
                  > > > > > > > Caused by: java.io.IOException: Call to
                  > > namenode/69.xxx.xxx.xxx:50001
                  > > > > > > failed on local exception: java.io.EOFException
                  > > > > > > > at org.apache.hadoop.ipc.Client.wrapException(Client.java:1142)
                  > > > > > > > at org.apache.hadoop.ipc.Client.call(Client.java:1110)
                  > > > > > > > at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:226)
                  > > > > > > > at $Proxy22.getProtocolVersion(Unknown Source)
                  > > > > > > > at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:398)
                  > > > > > > > at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:384)
                  > > > > > > > at
                  > > > > org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:111)
                  > > > > > > > at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:213)
                  > > > > > > > at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:180)
                  > > > > > > > at
                  > > > > > >
                  > > > >
                  > > org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:89)
                  > > > > > > > at
                  > > > > org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1514)
                  > > > > > > > at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:67)
                  > > > > > > > at
                  > > > > > >
                  > > org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:1548)
                  > > > > > > > at
                  > > org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1530)
                  > > > > > > > at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:228)
                  > > > > > > > at
                  > > > > > >
                  > > > >
                  > > org.apache.oozie.service.HadoopAccessorService.createFileSystem(HadoopAccessorService.java:141)
                  > > > > > > > ... 23 more
                  > > > > > > > Caused by: java.io.EOFException
                  > > > > > > > at java.io.DataInputStream.readInt(DataInputStream.java:375)
                  > > > > > > > at
                  > > > > > >
                  > > > >
                  > > org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:815)
                  > > > > > > > at org.apache.hadoop.ipc.Client$Connection.run(Client.java:724)
                  > > > > > > >
                  > > > > > > > in my oozie-site.xml I have the following services
                  > > > > > > > <property>
                  > > > > > > > <name>oozie.services</name>
                  > > > > > > > <value>
                  > > > > > > > org.apache.oozie.service.SchedulerService,
                  > > > > > > > org.apache.oozie.service.InstrumentationService,
                  > > > > > > > org.apache.oozie.service.CallableQueueService,
                  > > > > > > > org.apache.oozie.service.UUIDService,
                  > > > > > > > org.apache.oozie.service.ELService,
                  > > > > > > > org.apache.oozie.service.AuthorizationService,
                  > > > > > > > org.apache.oozie.service.MemoryLocksService,
                  > > > > > > > org.apache.oozie.service.DagXLogInfoService,
                  > > > > > > > org.apache.oozie.service.SchemaService,
                  > > > > > > > org.apache.oozie.service.LiteWorkflowAppService,
                  > > > > > > > org.apache.oozie.service.StoreService,
                  > > > > > > > org.apache.oozie.service.CoordinatorStoreService,
                  > > > > > > > org.apache.oozie.service.SLAStoreService,
                  > > > > > > > org.apache.oozie.service.DBLiteWorkflowStoreService,
                  > > > > > > > org.apache.oozie.service.CallbackService,
                  > > > > > > > org.apache.oozie.service.ActionService,
                  > > > > > > > org.apache.oozie.service.ActionCheckerService,
                  > > > > > > > org.apache.oozie.service.RecoveryService,
                  > > > > > > > org.apache.oozie.service.PurgeService,
                  > > > > > > > org.apache.oozie.service.CoordinatorEngineService,
                  > > > > > > > org.apache.oozie.service.DagEngineService,
                  > > > > > > > org.apache.oozie.service.CoordJobMatLookupTriggerService,
                  > > > > > > > org.apache.oozie.service.HadoopAccessorService
                  > > > > > > > </value>
                  > > > > > > > <description>
                  > > > > > > > All services to be created and managed by Oozie Services
                  > > singleton.
                  > > > > > > > Class names must be separated by commas.
                  > > > > > > > </description>
                  > > > > > > > </property>
                  > > > > > > >
                  > > > > > > > if I take out org.apache.oozie.service.HadoopAccessorService,
                  > > then I
                  > > > > will
                  > > > > > > get
                  > > > > > > > 2011-08-23 16:09:45,587 ERROR V1JobsServlet:522 - USER[felix]
                  > > > > > > GROUP[users] TOKEN[-] APP[-] JOB[-] ACTION[-] URL[POST
                  > > > > > > http://localhost:11000/oozie/v1/jobs?jobtype=pig] error, null
                  > > > > > > > java.lang.NullPointerException
                  > > > > > > > at
                  > > > > > >
                  > > > >
                  > > org.apache.oozie.service.AuthorizationService.authorizeForApp(AuthorizationService.java:283)
                  > > > > > > > at
                  > > > > > >
                  > > > >
                  > > org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.java:171)
                  > > > > > > > at
                  > > > > > >
                  > > > >
                  > > org.apache.oozie.servlet.BaseJobsServlet.doPost(BaseJobsServlet.java:89)
                  > > > > > > > at javax.servlet.http.HttpServlet.service(HttpServlet.java:637)
                  > > > > > > > at
                  > > > > > >
                  > > > >
                  > > org.apache.oozie.servlet.JsonRestServlet.service(JsonRestServlet.java:281)
                  > > > > > > > at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
                  > > > > > > > at
                  > > > > > >
                  > > > >
                  > > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
                  > > > > > > > at
                  > > > > > >
                  > > > >
                  > > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
                  > > > > > > > at
                  > > > > org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:123)
                  > > > > > > > at
                  > > > > > >
                  > > > >
                  > > com.cloudera.alfredo.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:371)
                  > > > > > > > at
                  > > org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:128)
                  > > > > > > > at
                  > > > > > >
                  > > > >
                  > > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
                  > > > > > > > at
                  > > > > > >
                  > > > >
                  > > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
                  > > > > > > > at
                  > > > > > >
                  > > > >
                  > > org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
                  > > > > > > > at
                  > > > > > >
                  > > > >
                  > > org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
                  > > > > > > > at
                  > > > > > >
                  > > > >
                  > > org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
                  > > > > > > > at
                  > > > > > >
                  > > > >
                  > > org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
                  > > > > > > > at
                  > > > > > >
                  > > > >
                  > > org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
                  > > > > > > > at
                  > > > > > >
                  > > > >
                  > > org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
                  > > > > > > > at
                  > > > > > >
                  > > > >
                  > > org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857)
                  > > > > > > > at
                  > > > > > >
                  > > > >
                  > > org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588)
                  > > > > > > > at
                  > > > > > >
                  > > org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
                  > > > > > > > at java.lang.Thread.run(Thread.java:619)
                  > > > > > > >
                  > > > > > > > your help is appreciated.
                  > > > > > > >
                  > > > > > > > Felix
                  > > > > > > >
                  > > > > > >
                  > > > > > >
                  > > > > > >
                  > > > > > >
                  > > > > > > ------------------------------------
                  > > > > > >
                  > > > > > > Yahoo! Groups Links
                  > > > > > >
                  > > > > > >
                  > > > > > >
                  > > > > > >
                  > > > > >
                  > > > >
                  > > > >
                  > > > >
                  > > > >
                  > > > > ------------------------------------
                  > > > >
                  > > > > Yahoo! Groups Links
                  > > > >
                  > > > >
                  > > > >
                  > > > >
                  > > >
                  > >
                  > >
                  > >
                  > >
                  > > ------------------------------------
                  > >
                  > > Yahoo! Groups Links
                  > >
                  > >
                  > >
                  > >
                  >
                • Felix
                  I have added hadoop.proxyuser.oozie.hosts * hadoop.proxyuser.oozie.groups
                  Message 8 of 11 , Aug 25, 2011
                  View Source
                  • 0 Attachment
                    I have added
                    <property>
                    <name>hadoop.proxyuser.oozie.hosts</name>
                    <value>*</value>
                    </property>
                    <property>
                    <name>hadoop.proxyuser.oozie.groups</name>
                    <value>*</value>
                    </property>

                    to the core-site.xml on namenode. After restart namenode, I still see the following exceptions.

                    2011-08-25 11:46:09,477 WARN V1JobsServlet:528 - USER[felix] GROUP[users] TOKEN[-] APP[-] JOB[-] ACTION[-] URL[POST http://localhost:11000/oozie/v1/jobs?jobtype=pig] error[E0902], E0902: Exception occured: [java.io.IOException: Call to namenode.xxx.xxx.com/xxx.xxx.xxx.xxx:50001 failed on local exception: java.io.EOFException]
                    org.apache.oozie.servlet.XServletException: E0902: Exception occured: [java.io.IOException: Call to namenode.xxx.xxx.com/xxx.xxx.xxx.xxx:50001 failed on local exception: java.io.EOFException]
                    at org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.java:179)
                    at org.apache.oozie.servlet.BaseJobsServlet.doPost(BaseJobsServlet.java:89)
                    at javax.servlet.http.HttpServlet.service(HttpServlet.java:637)
                    at org.apache.oozie.servlet.JsonRestServlet.service(JsonRestServlet.java:281)
                    at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
                    at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
                    at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
                    at org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:123)
                    at com.cloudera.alfredo.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:371)
                    at org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:128)
                    at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
                    at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
                    at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
                    at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
                    at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
                    at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
                    at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
                    at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
                    at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857)
                    at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588)
                    at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
                    at java.lang.Thread.run(Thread.java:619)
                    Caused by: org.apache.oozie.service.AuthorizationException: E0902: Exception occured: [java.io.IOException: Call to namenode.chi.bluekai.com/69.170.130.176:50001 failed on local exception: java.io.EOFException]
                    at org.apache.oozie.service.AuthorizationService.authorizeForApp(AuthorizationService.java:318)
                    at org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.java:171)
                    ... 21 more
                    Caused by: org.apache.oozie.service.HadoopAccessorException: E0902: Exception occured: [java.io.IOException: Call to namenode.chi.bluekai.com/69.170.130.176:50001 failed on local exception: java.io.EOFException]
                    at org.apache.oozie.service.KerberosHadoopAccessorService.createFileSystem(KerberosHadoopAccessorService.java:211)
                    at org.apache.oozie.service.AuthorizationService.authorizeForApp(AuthorizationService.java:283)
                    ... 22 more
                    Caused by: java.io.IOException: Call to namenode.xxx.xxx.com/xxx.xxx.xxx.xxx:50001 failed on local exception: java.io.EOFException
                    at org.apache.hadoop.ipc.Client.wrapException(Client.java:1142)
                    at org.apache.hadoop.ipc.Client.call(Client.java:1110)
                    at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:226)
                    at $Proxy22.getProtocolVersion(Unknown Source)
                    at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:398)
                    at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:384)
                    at org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:111)
                    at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:213)
                    at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:180)
                    at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:89)
                    at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1514)
                    at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:67)
                    at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:1548)
                    at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1530)
                    at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:228)
                    at org.apache.oozie.service.KerberosHadoopAccessorService$3.run(KerberosHadoopAccessorService.java:203)
                    at org.apache.oozie.service.KerberosHadoopAccessorService$3.run(KerberosHadoopAccessorService.java:194)
                    at java.security.AccessController.doPrivileged(Native Method)
                    at javax.security.auth.Subject.doAs(Subject.java:396)
                    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1127)
                    at org.apache.oozie.service.KerberosHadoopAccessorService.createFileSystem(KerberosHadoopAccessorService.java:194)
                    ... 23 more
                    Caused by: java.io.EOFException
                    at java.io.DataInputStream.readInt(DataInputStream.java:375)
                    at org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:815)
                    at org.apache.hadoop.ipc.Client$Connection.run(Client.java:724)
                  • Alejandro Abdelnur
                    Felix, It seems your email client has some issues and keeps sending emails to oozie-users@ alias. You are having issues with CDH setup and it is not
                    Message 9 of 11 , Aug 25, 2011
                    View Source
                    • 0 Attachment
                      Felix,

                      It seems your email client has some issues and keeps sending emails to oozie-users@ alias.

                      You are having issues with CDH setup and it is not appropriate to use the oozie-users@ alias, you should use the cdh-user@... alias.

                      To help you resolve your mail issue, please resend your email to the cdh-users@... alias and I'll try to help you there.

                      Thanks for understanding.

                      Alejandro

                      On Thu, Aug 25, 2011 at 10:19 AM, Felix <felixgao@...> wrote:
                      I have added
                       <property>
                             <name>hadoop.proxyuser.oozie.hosts</name>
                              <value>*</value>
                          </property>
                          <property>
                             <name>hadoop.proxyuser.oozie.groups</name>
                             <value>*</value>
                          </property>

                      to the core-site.xml on namenode.   After restart namenode,  I still see the following exceptions.

                      2011-08-25 11:46:09,477  WARN V1JobsServlet:528 - USER[felix] GROUP[users] TOKEN[-] APP[-] JOB[-] ACTION[-] URL[POST http://localhost:11000/oozie/v1/jobs?jobtype=pig] error[E0902], E0902: Exception occured: [java.io.IOException: Call to namenode.xxx.xxx.com/xxx.xxx.xxx.xxx:50001 failed on local exception: java.io.EOFException]
                      org.apache.oozie.servlet.XServletException: E0902: Exception occured: [java.io.IOException: Call to namenode.xxx.xxx.com/xxx.xxx.xxx.xxx:50001 failed on local exception: java.io.EOFException]
                             at org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.java:179)
                             at org.apache.oozie.servlet.BaseJobsServlet.doPost(BaseJobsServlet.java:89)
                             at javax.servlet.http.HttpServlet.service(HttpServlet.java:637)
                             at org.apache.oozie.servlet.JsonRestServlet.service(JsonRestServlet.java:281)
                             at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
                             at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
                             at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
                             at org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:123)
                             at com.cloudera.alfredo.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:371)
                             at org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:128)
                             at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
                             at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
                             at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
                             at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
                             at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
                             at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
                             at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
                             at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
                             at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857)
                             at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588)
                             at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
                             at java.lang.Thread.run(Thread.java:619)
                      Caused by: org.apache.oozie.service.AuthorizationException: E0902: Exception occured: [java.io.IOException: Call to namenode.chi.bluekai.com/69.170.130.176:50001 failed on local exception: java.io.EOFException]
                             at org.apache.oozie.service.AuthorizationService.authorizeForApp(AuthorizationService.java:318)
                             at org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.java:171)
                             ... 21 more
                      Caused by: org.apache.oozie.service.HadoopAccessorException: E0902: Exception occured: [java.io.IOException: Call to namenode.chi.bluekai.com/69.170.130.176:50001 failed on local exception: java.io.EOFException]
                             at org.apache.oozie.service.KerberosHadoopAccessorService.createFileSystem(KerberosHadoopAccessorService.java:211)
                             at org.apache.oozie.service.AuthorizationService.authorizeForApp(AuthorizationService.java:283)
                             ... 22 more
                      Caused by: java.io.IOException: Call to namenode.xxx.xxx.com/xxx.xxx.xxx.xxx:50001 failed on local exception: java.io.EOFException
                             at org.apache.hadoop.ipc.Client.wrapException(Client.java:1142)
                             at org.apache.hadoop.ipc.Client.call(Client.java:1110)
                             at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:226)
                             at $Proxy22.getProtocolVersion(Unknown Source)
                             at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:398)
                             at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:384)
                             at org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:111)
                             at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:213)
                             at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:180)
                             at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:89)
                             at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1514)
                             at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:67)
                             at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:1548)
                             at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1530)
                             at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:228)
                             at org.apache.oozie.service.KerberosHadoopAccessorService$3.run(KerberosHadoopAccessorService.java:203)
                             at org.apache.oozie.service.KerberosHadoopAccessorService$3.run(KerberosHadoopAccessorService.java:194)
                             at java.security.AccessController.doPrivileged(Native Method)
                             at javax.security.auth.Subject.doAs(Subject.java:396)
                             at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1127)
                             at org.apache.oozie.service.KerberosHadoopAccessorService.createFileSystem(KerberosHadoopAccessorService.java:194)
                             ... 23 more
                      Caused by: java.io.EOFException
                             at java.io.DataInputStream.readInt(DataInputStream.java:375)
                             at org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:815)
                             at org.apache.hadoop.ipc.Client$Connection.run(Client.java:724)




                      ------------------------------------

                      Yahoo! Groups Links

                      <*> To visit your group on the web, go to:
                         http://groups.yahoo.com/group/Oozie-users/

                      <*> Your email settings:
                         Individual Email | Traditional

                      <*> To change settings online go to:
                         http://groups.yahoo.com/group/Oozie-users/join
                         (Yahoo! ID required)

                      <*> To change settings via email:
                         Oozie-users-digest@yahoogroups.com
                         Oozie-users-fullfeatured@yahoogroups.com

                      <*> To unsubscribe from this group, send an email to:
                         Oozie-users-unsubscribe@yahoogroups.com

                      <*> Your use of Yahoo! Groups is subject to:
                         http://docs.yahoo.com/info/terms/


                    Your message has been successfully submitted and would be delivered to recipients shortly.