Loading ...
Sorry, an error occurred while loading the content.

Re: PeopleSoft DBA Forum Web server stuck ???

Expand Messages
  • Jorg Sander
    Sorry, but I do not have an explanation for that non-spawning behavior. But I can tell you that I observed spawning problems before. On AIX with PT 8.15 under
    Message 1 of 12 , Sep 24, 2003
    • 0 Attachment
      Sorry, but I do not have an explanation for that
      non-spawning behavior.
      But I can tell you that I observed spawning problems
      before. On AIX with PT 8.15 under some circumstances the
      appserver would not spawn (especially when there were long
      running queries). Something even more ridiculous happend
      on Solaris with PT 8.42, it just spawned until the whole
      box disappeared.


      On Wed, 24 Sep 2003 12:03:32 -0000
      "litbighor" <lehuyluan@...> wrote:
      >*This message was transferred with a trial version of
      >CommuniGate(tm) Pro*
      >Hi,
      >
      >You're right.
      >I had Min Instances=1 and Max Instances=3.
      >During the non-access, I have 1 in the App Serv Queue and
      >only 1 App
      >Serv process PSAPPSRV.
      >
      >I change Min Instances=2 then there's no problem now.
      >
      >But why the PSAPPSRV didn't spawn (max=3) ?
      >
      >Thanks.
      >
      >--- In psftdba@yahoogroups.com, <Jorg.Sander@m...> wrote:
      >> Not that I know a real sollution to your problem. But
      >>what about
      >the appserver. It sounds like whether you have only one
      >psappserver
      >handler there?
      >> Is spawning enabled? Seems like whether this one SQL is
      >>blokking
      >your appserver handler. Do you see requests in the
      >appserver queue?
      >>
      >>
      >> Met vriendelijke groet/Kind regards,
      >>
      >> Jörg Sander
      >>
      >> ING Nederland
      >> OPS&IT/CC/GS/ccHR/Infrastructuur
      >>
      >> L: GA 03.003
      >> T: 020-59 19 285
      >> E: Jorg.Sander@m...
      >>
      >> -----Original Message-----
      >> From: litbighor [mailto:lehuyluan@h...]
      >> Sent: dinsdag 23 september 2003 11:08
      >> To: psftdba@yahoogroups.com
      >> Subject: PeopleSoft DBA Forum Web server stuck ???
      >>
      >>
      >> Hi,
      >>
      >> I have a HRMS 8.3 Tools 8.19.06 on HP-UX 11i 64 bits.
      >> Webserv Weblogic ,Appserv, Procserv, Database Oracle is
      >>on the same
      >> host.
      >> (logical 3 tiers)
      >>
      >> I have a very bad problem with it :
      >>
      >> - The Webserv get stuck... I mean it works but when
      >>someone tries to
      >> log on (IE 6), it seems working and working.
      >>
      >> - I check the system with a top :
      >> 1 process oracle working 25% CPU only. the machine is
      >>not
      >overloaded !
      >>
      >> - I check the database and only one SQL select :
      >> SELECT DISTINCT A.EMPLID , A.NAME , A.COURSE ,
      >>A.SESSION_NBR ,
      >> A.COURSE_TITLE ,
      >> A.COURSE_END_DT FROM PS_SPITRN_SACST_VW A WHERE
      >>(A.COURSE IN (
      >SELECT
      >> B.COURSE FROM PS_SPITRN_STG_SECU B WHERE
      >>(B.BUSINESS_UNIT=( SELECT
      >> C.BUSINESS_UNIT FROM PS_OPR_DEF_TBL_HR C WHERE
      >>C.OPRCLASS=( SELECT
      >> E.OPRCLASS FROM PSOPRDEFN E WHERE E.OPRID='DAG')) OR
      >> B.BUSINESS_UNIT='ST'))) ORDER BY EMPLID, NAME, COURSE,
      >>SESSION_NBR,
      >> COURSE_TITLE
      >>
      >> - No update or delete
      >> - There's no lock at all !
      >>
      >> - I decided to kill the session :
      >> and then at this instant, the browser get connected to
      >>Peoplesoft !!
      >>
      >> It's unbelievable !
      >> How can I prevent it ?
      >> Do you have this kind of problem ?
      >>
      >> Thanks.
      >>
      >>
      >>
      >>
      >>
      >>
      >>
      >>
      >>
      >>
      >>
      >> Yahoo! Groups Sponsor
      >>
      >> ADVERTISEMENT
      >>
      ><http://rd.yahoo.com/M=194081.3897168.5135684.1261774/D=egroupweb/S=17
      >07698825:HM/A=1706996/R=0/SIG=11p5b9ris/*http://www.ediets.com/start.c
      >fm?code=30509&media=atkins> click here
      >> <http://us.adserver.yahoo.com/l?
      >M=194081.3897168.5135684.1261774/D=egroupmail/S=:HM/A=1706996/rand=218
      >369256>
      >>
      >> To unsubscribe from this group, send an email to:
      >> psftdba-unsubscribe@yahoogroups.com
      >>
      >> The PeopleSoft DBA Forum is managed by Go-Faster
      >>Consultancy Ltd.
      >http://www.go-faster.co.uk
      >>
      >> Your use of Yahoo! Groups is subject to the Yahoo! Terms
      >>of Service
      ><http://docs.yahoo.com/info/terms/> .
      >>
      >>
      >>
      >>
      >> -----------------------------------------------------------------
      >> ATTENTION:
      >> The information in this electronic mail message is
      >>private and
      >> confidential, and only intended for the addressee.
      >>Should you
      >> receive this message by mistake, you are hereby notified
      >>that
      >> any disclosure, reproduction, distribution or use of
      >>this
      >> message is strictly prohibited. Please inform the sender
      >>by
      >> reply transmission and delete the message without
      >>copying or
      >> opening it.
      >>
      >> Messages and attachments are scanned for all viruses
      >>known.
      >> If this message contains password-protected attachments,
      >>the
      >> files have NOT been scanned for viruses by the ING mail
      >>domain.
      >> Always scan attachments before opening them.
      >> -----------------------------------------------------------------
      >
      >
      >
      >------------------------ Yahoo! Groups Sponsor
      >
      >To unsubscribe from this group, send an email to:
      >psftdba-unsubscribe@yahoogroups.com
      >
      >The PeopleSoft DBA Forum is managed by Go-Faster
      >Consultancy Ltd. http://www.go-faster.co.uk
      >
      >Your use of Yahoo! Groups is subject to
      >http://docs.yahoo.com/info/terms/
      >
      >
      >
    • litbighor
      Hi, The problem is back again but this time there s no ACTIVE (v$session) sql sessions ... Current Service ... JSL 00095.00200 JSLGRP 200
      Message 2 of 12 , Sep 25, 2003
      • 0 Attachment
        Hi,

        The problem is back again but this time there's no ACTIVE (v$session)
        sql sessions

        See that :

        > Prog Name Queue Name Grp Name ID RqDone Load Done
        Current Service
        --------- ---------- -------- -- ------ --------- ---------
        ------
        JSL 00095.00200 JSLGRP 200 0 0 ( IDLE )
        BBL 45837 HRINT 0 0 0 ( IDLE )
        PSAPPSRV APPQ APPSRV 1 558 27900 ICPanel
        PSAPPSRV APPQ APPSRV 2 612 30600 ICPanel
        PSAPPSRV APPQ APPSRV 3 2353 117650 ICPanel
        JREPSVR 00094.00250 JREPGRP 250 9 450 ( IDLE )
        WSL 00001.00020 BASE 20 0 0 ( IDLE )
        PSSAMSRV SAMQ APPSRV 100 0 0 ( IDLE )

        >


        > LMID User Name Client Name Time Status
        Bgn/Cmmt/Abrt
        --------------- --------------- --------------- -------- ------- -----
        --------
        HRINT psoft WSH 18:50:42 IDLE 0/0/0
        HRINT psoft JSH 18:50:42 IDLE 0/0/0
        HRINT SKI 147.98.102.33 0:12:21 IDLE/W 0/0/0
        HRINT JBV 147.98.102.6 0:41:46 IDLE/W 0/0/0
        HRINT VEBESC1 147.98.102.6 0:25:47 BUSY/W 0/0/0
        HRINT DAG 147.98.102.32 0:49:39 BUSY/W 0/0/0
        HRINT DAG 147.98.102.32 0:13:04 IDLE/W 0/0/0
        HRINT SKI 147.98.102.33 0:09:09 BUSY/W 0/0/0
        HRINT SKI 147.98.102.33 0:09:12 BUSY/W 0/0/0
        HRINT DAG 147.98.102.32 0:01:54 BUSY/W 0/0/0
        HRINT psoft tmadmin 0:00:00 IDLE 0/0/0

        >

        > Prog Name Queue Name # Serve Wk Queued # Queued Ave. Len
        Machine
        --------- ------------------- --------- -------- -------- --
        -----
        PSAPPSRV APPQ 3 - 14 -
        xxx
        WSL 00001.00020 1 - 0 -
        xxx
        JSL 00095.00200 1 - 0 -
        xxx
        BBL 45837 1 - 0 -
        xxx
        PSSAMSRV SAMQ 1 - 0 -
        xxx
        JREPSVR 00094.00250 1 - 0 -
        xxx
        >


        System: XXX Thu Sep 25
        10:36:20 2003
        Load averages: 1.53, 1.55, 1.55
        252 processes: 232 sleeping, 20 running
        Cpu states:
        CPU LOAD USER NICE SYS IDLE BLOCK SWAIT INTR SSYS
        0 1.47 15.2% 0.0% 84.8% 0.0% 0.0% 0.0% 0.0% 0.0%
        1 1.59 15.9% 0.0% 84.1% 0.0% 0.0% 0.0% 0.0% 0.0%
        --- ---- ----- ----- ----- ----- ----- ----- ----- -----
        avg 1.53 15.5% 0.0% 84.5% 0.0% 0.0% 0.0% 0.0% 0.0%

        Memory: 1273676K (885080K) real, 2099208K (1501556K) virtual, 46984K
        free Page# 1/11

        CPU TTY PID USERNAME PRI NI SIZE RES STATE TIME %WCPU %
        CPU COMMAND
        0 pts/ta 14022 psoft 241 20 157M 90376K run 948:32 87.12
        86.96 PSAPPSRV
        0 pts/ta 14035 psoft 241 20 163M 93332K run 943:33 56.47
        56.37 PSAPPSRV
        1 pts/ta 16347 psoft 241 20 144M 75080K run 55:11 54.39
        54.29 PSAPPSRV
        1 pts/tb 14296 psoft 152 20 264M 87724K run 2:57 0.61
        0.61 java
        0 ? 36 root 152 20 6464K 6464K run 39:58 0.40
        0.39 vxfsd
        1 pts/ta 23177 psoft 178 20 21188K 824K run 0:00 0.46
        0.36 top

        No CPU overloading
        No active SQL sessions...
        No swapping...

        What are doing the PSAPPSRV process : there's no sql active ?

        I really don't understand.


        --- In psftdba@yahoogroups.com, "litbighor" <lehuyluan@h...> wrote:
        > Hi,
        >
        > You're right.
        > I had Min Instances=1 and Max Instances=3.
        > During the non-access, I have 1 in the App Serv Queue and only 1
        App
        > Serv process PSAPPSRV.
        >
        > I change Min Instances=2 then there's no problem now.
        >
        > But why the PSAPPSRV didn't spawn (max=3) ?
        >
        > Thanks.
        >
        > --- In psftdba@yahoogroups.com, <Jorg.Sander@m...> wrote:
        > > Not that I know a real sollution to your problem. But what about
        > the appserver. It sounds like whether you have only one psappserver
        > handler there?
        > > Is spawning enabled? Seems like whether this one SQL is blokking
        > your appserver handler. Do you see requests in the appserver queue?
        > >
        > >
        > > Met vriendelijke groet/Kind regards,
        > >
        > > Jörg Sander
        > >
        > > ING Nederland
        > > OPS&IT/CC/GS/ccHR/Infrastructuur
        > >
        > > L: GA 03.003
        > > T: 020-59 19 285
        > > E: Jorg.Sander@m...
        > >
        > > -----Original Message-----
        > > From: litbighor [mailto:lehuyluan@h...]
        > > Sent: dinsdag 23 september 2003 11:08
        > > To: psftdba@yahoogroups.com
        > > Subject: PeopleSoft DBA Forum Web server stuck ???
        > >
        > >
        > > Hi,
        > >
        > > I have a HRMS 8.3 Tools 8.19.06 on HP-UX 11i 64 bits.
        > > Webserv Weblogic ,Appserv, Procserv, Database Oracle is on the
        same
        > > host.
        > > (logical 3 tiers)
        > >
        > > I have a very bad problem with it :
        > >
        > > - The Webserv get stuck... I mean it works but when someone tries
        to
        > > log on (IE 6), it seems working and working.
        > >
        > > - I check the system with a top :
        > > 1 process oracle working 25% CPU only. the machine is not
        > overloaded !
        > >
        > > - I check the database and only one SQL select :
        > > SELECT DISTINCT A.EMPLID , A.NAME , A.COURSE , A.SESSION_NBR ,
        > > A.COURSE_TITLE ,
        > > A.COURSE_END_DT FROM PS_SPITRN_SACST_VW A WHERE (A.COURSE IN (
        > SELECT
        > > B.COURSE FROM PS_SPITRN_STG_SECU B WHERE (B.BUSINESS_UNIT=(
        SELECT
        > > C.BUSINESS_UNIT FROM PS_OPR_DEF_TBL_HR C WHERE C.OPRCLASS=(
        SELECT
        > > E.OPRCLASS FROM PSOPRDEFN E WHERE E.OPRID='DAG')) OR
        > > B.BUSINESS_UNIT='ST'))) ORDER BY EMPLID, NAME, COURSE,
        SESSION_NBR,
        > > COURSE_TITLE
        > >
        > > - No update or delete
        > > - There's no lock at all !
        > >
        > > - I decided to kill the session :
        > > and then at this instant, the browser get connected to
        Peoplesoft !!
        > >
        > > It's unbelievable !
        > > How can I prevent it ?
        > > Do you have this kind of problem ?
        > >
        > > Thanks.
        > >
        > >
        > >
        > >
        > >
        > >
        > >
        > >
        > >
        > >
        > >
        > > Yahoo! Groups Sponsor
        > >
        > > ADVERTISEMENT
        > >
        >
        <http://rd.yahoo.com/M=194081.3897168.5135684.1261774/D=egroupweb/S=17
        >
        07698825:HM/A=1706996/R=0/SIG=11p5b9ris/*http://www.ediets.com/start.c
        > fm?code=30509&media=atkins> click here
        > > <http://us.adserver.yahoo.com/l?
        >
        M=194081.3897168.5135684.1261774/D=egroupmail/S=:HM/A=1706996/rand=218
        > 369256>
        > >
        > > To unsubscribe from this group, send an email to:
        > > psftdba-unsubscribe@yahoogroups.com
        > >
        > > The PeopleSoft DBA Forum is managed by Go-Faster Consultancy Ltd.
        > http://www.go-faster.co.uk
        > >
        > > Your use of Yahoo! Groups is subject to the Yahoo! Terms of
        Service
        > <http://docs.yahoo.com/info/terms/> .
        > >
        > >
        > >
        > >
        > > -----------------------------------------------------------------
        > > ATTENTION:
        > > The information in this electronic mail message is private and
        > > confidential, and only intended for the addressee. Should you
        > > receive this message by mistake, you are hereby notified that
        > > any disclosure, reproduction, distribution or use of this
        > > message is strictly prohibited. Please inform the sender by
        > > reply transmission and delete the message without copying or
        > > opening it.
        > >
        > > Messages and attachments are scanned for all viruses known.
        > > If this message contains password-protected attachments, the
        > > files have NOT been scanned for viruses by the ING mail domain.
        > > Always scan attachments before opening them.
        > > -----------------------------------------------------------------
      • Jorg.Sander@mail.ing.nl
        I do not know what your appservers are doing but my feeling is that you have at least a CPU overload. May be I am blind but what about these system
        Message 3 of 12 , Sep 25, 2003
        • 0 Attachment
          I do not know what your appservers are doing but my feeling is that you have at least a CPU overload.
          May be I am blind but what about these system percentages?
           
          CPU   LOAD   USER   NICE    SYS   IDLE  BLOCK  SWAIT   INTR   SSYS
          0    1.47  15.2%   0.0%  84.8%   0.0%   0.0%   0.0%   0.0%   0.0%
          1    1.59  15.9%   0.0%  84.1%   0.0%   0.0%   0.0%   0.0%   0.0%
          ---   ----  -----  -----  -----  -----  -----  -----  -----  -----
          avg   1.53  15.5%   0.0%  84.5%   0.0%   0.0%   0.0%   0.0%   0.0%

          Met vriendelijke groet/Kind regards,

          Jörg Sander

          ING Nederland
          OPS&IT/CC/GS/ccHR/Infrastructuur

          L: GA 03.003
          T: 020-59 19 285
          E: Jorg.Sander@...

          -----Original Message-----
          From: litbighor [mailto:lehuyluan@...]
          Sent: donderdag 25 september 2003 11:37
          To: psftdba@yahoogroups.com
          Subject: Re: PeopleSoft DBA Forum Web server stuck ???

          Hi,

          The problem is back again but this time there's no ACTIVE (v$session)
          sql sessions

          See that :

          > Prog Name      Queue Name  Grp Name      ID RqDone Load Done
          Current Service
          ---------      ----------  --------      -- ------ --------- ---------
          ------
          JSL            00095.00200 JSLGRP       200      0         0 (  IDLE )
          BBL            45837       HRINT          0      0         0 (  IDLE )
          PSAPPSRV       APPQ        APPSRV         1    558     27900 ICPanel
          PSAPPSRV       APPQ        APPSRV         2    612     30600 ICPanel
          PSAPPSRV       APPQ        APPSRV         3   2353    117650 ICPanel
          JREPSVR        00094.00250 JREPGRP      250      9       450 (  IDLE )
          WSL            00001.00020 BASE          20      0         0 (  IDLE )
          PSSAMSRV       SAMQ        APPSRV       100      0         0 (  IDLE )

          >


          >      LMID         User Name       Client Name    Time    Status 
          Bgn/Cmmt/Abrt
          --------------- --------------- --------------- -------- ------- -----
          --------
          HRINT           psoft           WSH             18:50:42 IDLE    0/0/0
          HRINT           psoft           JSH             18:50:42 IDLE    0/0/0
          HRINT           SKI             147.98.102.33    0:12:21 IDLE/W  0/0/0
          HRINT           JBV             147.98.102.6     0:41:46 IDLE/W  0/0/0
          HRINT           VEBESC1         147.98.102.6     0:25:47 BUSY/W  0/0/0
          HRINT           DAG             147.98.102.32    0:49:39 BUSY/W  0/0/0
          HRINT           DAG             147.98.102.32    0:13:04 IDLE/W  0/0/0
          HRINT           SKI             147.98.102.33    0:09:09 BUSY/W  0/0/0
          HRINT           SKI             147.98.102.33    0:09:12 BUSY/W  0/0/0
          HRINT           DAG             147.98.102.32    0:01:54 BUSY/W  0/0/0
          HRINT           psoft           tmadmin          0:00:00 IDLE    0/0/0

          >

          > Prog Name      Queue Name  # Serve Wk Queued  # Queued  Ave. Len   
          Machine
          ---------      ------------------- ---------  --------  --------    --
          -----
          PSAPPSRV       APPQ              3         -        14         -     
          xxx
          WSL            00001.00020       1         -         0         -     
          xxx
          JSL            00095.00200       1         -         0         -     
          xxx
          BBL            45837             1         -         0         -     
          xxx
          PSSAMSRV       SAMQ              1         -         0         -     
          xxx
          JREPSVR        00094.00250       1         -         0         -     
          xxx
          >


          System: XXX                                        Thu Sep 25
          10:36:20 2003
          Load averages: 1.53, 1.55, 1.55
          252 processes: 232 sleeping, 20 running
          Cpu states:
          CPU   LOAD   USER   NICE    SYS   IDLE  BLOCK  SWAIT   INTR   SSYS
          0    1.47  15.2%   0.0%  84.8%   0.0%   0.0%   0.0%   0.0%   0.0%
          1    1.59  15.9%   0.0%  84.1%   0.0%   0.0%   0.0%   0.0%   0.0%
          ---   ----  -----  -----  -----  -----  -----  -----  -----  -----
          avg   1.53  15.5%   0.0%  84.5%   0.0%   0.0%   0.0%   0.0%   0.0%

          Memory: 1273676K (885080K) real, 2099208K (1501556K) virtual, 46984K
          free  Page# 1/11

          CPU TTY     PID USERNAME PRI NI   SIZE    RES STATE    TIME %WCPU  %
          CPU COMMAND
          0 pts/ta 14022 psoft    241 20   157M 90376K run    948:32 87.12
          86.96 PSAPPSRV
          0 pts/ta 14035 psoft    241 20   163M 93332K run    943:33 56.47
          56.37 PSAPPSRV
          1 pts/ta 16347 psoft    241 20   144M 75080K run     55:11 54.39
          54.29 PSAPPSRV
          1 pts/tb 14296 psoft    152 20   264M 87724K run      2:57  0.61 
          0.61 java
          0   ?       36 root     152 20  6464K  6464K run     39:58  0.40 
          0.39 vxfsd
          1 pts/ta 23177 psoft    178 20 21188K   824K run      0:00  0.46 
          0.36 top

          No CPU overloading
          No active SQL sessions...
          No swapping...

          What are doing the PSAPPSRV process : there's no sql active ?

          I really don't understand.


          --- In psftdba@yahoogroups.com, "litbighor" <lehuyluan@h...> wrote:
          > Hi,
          >
          > You're right.
          > I had Min Instances=1 and Max Instances=3.
          > During the non-access, I have 1 in the App Serv Queue and only 1
          App
          > Serv process PSAPPSRV.
          >
          > I change Min Instances=2 then there's no problem now.
          >
          > But why the PSAPPSRV didn't spawn (max=3) ?
          >
          > Thanks.
          >
          > --- In psftdba@yahoogroups.com, <Jorg.Sander@m...> wrote:
          > > Not that I know a real sollution to your problem. But what about
          > the appserver. It sounds like whether you have only one psappserver
          > handler there?
          > > Is spawning enabled? Seems like whether this one SQL is blokking
          > your appserver handler. Do you see requests in the appserver queue?
          > > 
          > >
          > > Met vriendelijke groet/Kind regards,
          > >
          > > Jörg Sander
          > >
          > > ING Nederland
          > > OPS&IT/CC/GS/ccHR/Infrastructuur
          > >
          > > L: GA 03.003
          > > T: 020-59 19 285
          > > E: Jorg.Sander@m...
          > >
          > > -----Original Message-----
          > > From: litbighor [mailto:lehuyluan@h...]
          > > Sent: dinsdag 23 september 2003 11:08
          > > To: psftdba@yahoogroups.com
          > > Subject: PeopleSoft DBA Forum Web server stuck ???
          > >
          > >
          > > Hi,
          > >
          > > I have a HRMS 8.3 Tools 8.19.06 on HP-UX 11i 64 bits.
          > > Webserv Weblogic ,Appserv, Procserv, Database Oracle is on the
          same
          > > host.
          > > (logical 3 tiers)
          > >
          > > I have a very bad problem with it :
          > >
          > > - The Webserv get stuck... I mean it works but when someone tries
          to
          > > log on (IE 6), it seems working and working.
          > >
          > > - I check the system with a top :
          > > 1 process oracle working 25% CPU only. the machine is not
          > overloaded !
          > >
          > > - I check the database and only one SQL select :
          > > SELECT DISTINCT A.EMPLID , A.NAME , A.COURSE , A.SESSION_NBR ,
          > > A.COURSE_TITLE ,
          > > A.COURSE_END_DT FROM PS_SPITRN_SACST_VW A WHERE (A.COURSE IN (
          > SELECT
          > > B.COURSE FROM PS_SPITRN_STG_SECU B WHERE (B.BUSINESS_UNIT=(
          SELECT
          > > C.BUSINESS_UNIT FROM PS_OPR_DEF_TBL_HR C WHERE C.OPRCLASS=(
          SELECT
          > > E.OPRCLASS FROM PSOPRDEFN E WHERE E.OPRID='DAG')) OR
          > > B.BUSINESS_UNIT='ST'))) ORDER BY EMPLID, NAME, COURSE,
          SESSION_NBR,
          > > COURSE_TITLE
          > >
          > > - No update or  delete
          > > - There's no lock at all !
          > >
          > > - I decided to kill the session :
          > > and then at this instant, the browser get connected to
          Peoplesoft !!
          > >
          > > It's unbelievable !
          > > How can I prevent it ?
          > > Do you have this kind of problem ?
          > >
          > > Thanks.
          > >
          > >
          > >
          > >
          > >
          > >  
          > >
          > >
          > >
          > >
          > >
          > > Yahoo! Groups Sponsor     
          > >
          > > ADVERTISEMENT
          > > 
          >
          <http://rd.yahoo.com/M=194081.3897168.5135684.1261774/D=egroupweb/S=17
          >
          07698825:HM/A=1706996/R=0/SIG=11p5b9ris/*http://www.ediets.com/start.c
          > fm?code=30509&media=atkins> click here     
          > >   <http://us.adserver.yahoo.com/l?
          >
          M=194081.3897168.5135684.1261774/D=egroupmail/S=:HM/A=1706996/rand=218
          > 369256>      
          > >
          > > To unsubscribe from this group, send an email to:
          > > psftdba-unsubscribe@yahoogroups.com
          > >
          > > The PeopleSoft DBA Forum is managed by Go-Faster Consultancy Ltd.
          > http://www.go-faster.co.uk
          > >
          > > Your use of Yahoo! Groups is subject to the Yahoo! Terms of
          Service
          > <http://docs.yahoo.com/info/terms/> .
          > >
          > >
          > >
          > >
          > > -----------------------------------------------------------------
          > > ATTENTION:
          > > The information in this electronic mail message is private and
          > > confidential, and only intended for the addressee. Should you
          > > receive this message by mistake, you are hereby notified that
          > > any disclosure, reproduction, distribution or use of this
          > > message is strictly prohibited. Please inform the sender by
          > > reply transmission and delete the message without copying or
          > > opening it.
          > >
          > > Messages and attachments are scanned for all viruses known.
          > > If this message contains password-protected attachments, the
          > > files have NOT been scanned for viruses by the ING mail domain.
          > > Always scan attachments before opening them.
          > > -----------------------------------------------------------------




          To unsubscribe from this group, send an email to:
          psftdba-unsubscribe@yahoogroups.com

          The PeopleSoft DBA Forum is managed by Go-Faster Consultancy Ltd. http://www.go-faster.co.uk


          Your use of Yahoo! Groups is subject to the Yahoo! Terms of Service.
        • David Kurtz
          I have seen this happen in a number of places, and I don t know what causes it.It is typical that the PSAPPSRV processes are shown as handling a process, as
          Message 4 of 12 , Sep 25, 2003
          • 0 Attachment
            I have seen this happen in a number of places, and I don't know what
            causes it.

            It is typical that the PSAPPSRV processes are shown as handling a
            process, as described in the thread. Though not all of the processes
            will be stuck. You only know they are stuck because you run several
            PSRs in tmadmin and the number of requests done does not change (this
            could be used to build a script to detect the problem when it occurs).
            If not corrected this problem will spread and eventually all the
            servers are stuck and the system grinds to a halt!

            > Prog Name Queue Name Grp Name ID RqDone Load Done Current
            Service
            > --------- ---------- -------- -- ------ --------- ---------
            > JSL 00095.00200 JSLGRP 200 0 0 ( IDLE )
            > BBL 45837 HRINT 0 0 0 ( IDLE )
            > PSAPPSRV APPQ APPSRV 1 558 27900 ICPanel
            > PSAPPSRV APPQ APPSRV 2 612 30600 ICPanel
            > PSAPPSRV APPQ APPSRV 3 2353 117650 ICPanel
            > JREPSVR 00094.00250 JREPGRP 250 9 450 ( IDLE )
            > WSL 00001.00020 BASE 20 0 0 ( IDLE )
            > PSSAMSRV SAMQ APPSRV 100 0 0 ( IDLE )

            It is also typical that the servers are consuming nearly 100% of a
            CPU, and that it is all system time and not user time. That is
            interesting because it shows that it is a problem with a system call
            rather than user code.

            What I think may be happening is that one queues or one of the
            databases in the Bulletin board has become locked in some way. When
            messages are put onto or taken off a queue there is a brief lock taken
            So that server processes are trying to update it. When a server is
            restarted then a brief lock is placed on a database in the bulletin
            board that keeps a track of how many servers are running.

            This also, deliberately, prevents more than server being started at a
            time. Hence there is a second variant of this problem when, if the
            recycle count is low or servers crash and have to be restarted I have
            also seen the status stuck as 'Restarting'.

            The queues are Unix IPC queues, and the bulletin board is a shared
            memory segment. All these structures are accessed via the system
            functions provides by the Unix kernel. So if one of these calls gets
            into a loop then it will be reported as system time.

            > CPU LOAD USER NICE SYS IDLE BLOCK SWAIT INTR SSYS
            > 0 1.47 15.2% 0.0% 84.8% 0.0% 0.0% 0.0% 0.0% 0.0%
            > 1 1.59 15.9% 0.0% 84.1% 0.0% 0.0% 0.0% 0.0% 0.0%
            > --- ---- ----- ----- ----- ----- ----- ----- ----- -----
            > avg 1.53 15.5% 0.0% 84.5% 0.0% 0.0% 0.0% 0.0% 0.0%

            The corrective action is to shutdown the server that is holding the
            lock (in tmadmin stop -g APPSRV -i <n>). You usually have to force it
            down (cntr c the shutdown and you will be asked if you want to force
            the shutdown), and sometimes you also have to kill it by hand. Then
            restart it (boot -g APPSRV -i <n>).

            I suspect that this may be caused by a memory leak in the PeopleSoft
            code, but I am not at all sure of that and I cannot prove it. You
            enable 'changetrace on' and send the trace in the Tuxlog to
            PeopleSoft, but it generates a lot of output and will seriously impact
            performance.

            _____________________________
            David Kurtz
            Go-Faster Consultancy Ltd.
            tel: +44 7771 760660
            fax: +44 7092 348865
            mailto:david.kurtz@...
            web: www.go-faster.co.uk
            PeopleSoft DBA Forum: http://groups.yahoo.com/group/psftdba






            --- In psftdba@yahoogroups.com, <Jorg.Sander@m...> wrote:
            > I do not know what your appservers are doing but my feeling is that
            you have at least a CPU overload.
            > May be I am blind but what about these system percentages?
            >
            > CPU LOAD USER NICE SYS IDLE BLOCK SWAIT INTR SSYS
            > 0 1.47 15.2% 0.0% 84.8% 0.0% 0.0% 0.0% 0.0% 0.0%
            > 1 1.59 15.9% 0.0% 84.1% 0.0% 0.0% 0.0% 0.0% 0.0%
            > --- ---- ----- ----- ----- ----- ----- ----- ----- -----
            > avg 1.53 15.5% 0.0% 84.5% 0.0% 0.0% 0.0% 0.0% 0.0%
            >
            >
            > Met vriendelijke groet/Kind regards,
            >
            > Jörg Sander
            >
            > ING Nederland
            > OPS&IT/CC/GS/ccHR/Infrastructuur
            >
            > L: GA 03.003
            > T: 020-59 19 285
            > E: Jorg.Sander@m...
            >
            > -----Original Message-----
            > From: litbighor [mailto:lehuyluan@h...]
            > Sent: donderdag 25 september 2003 11:37
            > To: psftdba@yahoogroups.com
            > Subject: Re: PeopleSoft DBA Forum Web server stuck ???
            >
            >
            > Hi,
            >
            > The problem is back again but this time there's no ACTIVE (v$session)
            > sql sessions
            >
            > See that :
            >
            > > Prog Name Queue Name Grp Name ID RqDone Load Done
            > Current Service
            > --------- ---------- -------- -- ------ --------- ---------
            > ------
            > JSL 00095.00200 JSLGRP 200 0 0 ( IDLE )
            > BBL 45837 HRINT 0 0 0 ( IDLE )
            > PSAPPSRV APPQ APPSRV 1 558 27900 ICPanel
            > PSAPPSRV APPQ APPSRV 2 612 30600 ICPanel
            > PSAPPSRV APPQ APPSRV 3 2353 117650 ICPanel
            > JREPSVR 00094.00250 JREPGRP 250 9 450 ( IDLE )
            > WSL 00001.00020 BASE 20 0 0 ( IDLE )
            > PSSAMSRV SAMQ APPSRV 100 0 0 ( IDLE )
            >
            > >
            >
            >
            > > LMID User Name Client Name Time Status
            > Bgn/Cmmt/Abrt
            > --------------- --------------- --------------- -------- ------- -----
            > --------
            > HRINT psoft WSH 18:50:42 IDLE 0/0/0
            > HRINT psoft JSH 18:50:42 IDLE 0/0/0
            > HRINT SKI 147.98.102.33 0:12:21 IDLE/W 0/0/0
            > HRINT JBV 147.98.102.6 0:41:46 IDLE/W 0/0/0
            > HRINT VEBESC1 147.98.102.6 0:25:47 BUSY/W 0/0/0
            > HRINT DAG 147.98.102.32 0:49:39 BUSY/W 0/0/0
            > HRINT DAG 147.98.102.32 0:13:04 IDLE/W 0/0/0
            > HRINT SKI 147.98.102.33 0:09:09 BUSY/W 0/0/0
            > HRINT SKI 147.98.102.33 0:09:12 BUSY/W 0/0/0
            > HRINT DAG 147.98.102.32 0:01:54 BUSY/W 0/0/0
            > HRINT psoft tmadmin 0:00:00 IDLE 0/0/0
            >
            > >
            >
            > > Prog Name Queue Name # Serve Wk Queued # Queued Ave. Len
            > Machine
            > --------- ------------------- --------- -------- -------- --
            > -----
            > PSAPPSRV APPQ 3 - 14 -
            > xxx
            > WSL 00001.00020 1 - 0 -
            > xxx
            > JSL 00095.00200 1 - 0 -
            > xxx
            > BBL 45837 1 - 0 -
            > xxx
            > PSSAMSRV SAMQ 1 - 0 -
            > xxx
            > JREPSVR 00094.00250 1 - 0 -
            > xxx
            > >
            >
            >
            > System: XXX Thu Sep 25
            > 10:36:20 2003
            > Load averages: 1.53, 1.55, 1.55
            > 252 processes: 232 sleeping, 20 running
            > Cpu states:
            > CPU LOAD USER NICE SYS IDLE BLOCK SWAIT INTR SSYS
            > 0 1.47 15.2% 0.0% 84.8% 0.0% 0.0% 0.0% 0.0% 0.0%
            > 1 1.59 15.9% 0.0% 84.1% 0.0% 0.0% 0.0% 0.0% 0.0%
            > --- ---- ----- ----- ----- ----- ----- ----- ----- -----
            > avg 1.53 15.5% 0.0% 84.5% 0.0% 0.0% 0.0% 0.0% 0.0%
            >
            > Memory: 1273676K (885080K) real, 2099208K (1501556K) virtual, 46984K
            > free Page# 1/11
            >
            > CPU TTY PID USERNAME PRI NI SIZE RES STATE TIME %WCPU %
            > CPU COMMAND
            > 0 pts/ta 14022 psoft 241 20 157M 90376K run 948:32 87.12
            > 86.96 PSAPPSRV
            > 0 pts/ta 14035 psoft 241 20 163M 93332K run 943:33 56.47
            > 56.37 PSAPPSRV
            > 1 pts/ta 16347 psoft 241 20 144M 75080K run 55:11 54.39
            > 54.29 PSAPPSRV
            > 1 pts/tb 14296 psoft 152 20 264M 87724K run 2:57 0.61
            > 0.61 java
            > 0 ? 36 root 152 20 6464K 6464K run 39:58 0.40
            > 0.39 vxfsd
            > 1 pts/ta 23177 psoft 178 20 21188K 824K run 0:00 0.46
            > 0.36 top
            >
            > No CPU overloading
            > No active SQL sessions...
            > No swapping...
            >
            > What are doing the PSAPPSRV process : there's no sql active ?
            >
            > I really don't understand.
            >
            >
            > --- In psftdba@yahoogroups.com, "litbighor" <lehuyluan@h...> wrote:
            > > Hi,
            > >
            > > You're right.
            > > I had Min Instances=1 and Max Instances=3.
            > > During the non-access, I have 1 in the App Serv Queue and only 1
            > App
            > > Serv process PSAPPSRV.
            > >
            > > I change Min Instances=2 then there's no problem now.
            > >
            > > But why the PSAPPSRV didn't spawn (max=3) ?
            > >
            > > Thanks.
            > >
            > > --- In psftdba@yahoogroups.com, <Jorg.Sander@m...> wrote:
            > > > Not that I know a real sollution to your problem. But what about
            > > the appserver. It sounds like whether you have only one psappserver
            > > handler there?
            > > > Is spawning enabled? Seems like whether this one SQL is blokking
            > > your appserver handler. Do you see requests in the appserver queue?
            > > >
            > > >
            > > > Met vriendelijke groet/Kind regards,
            > > >
            > > > Jörg Sander
            > > >
            > > > ING Nederland
            > > > OPS&IT/CC/GS/ccHR/Infrastructuur
            > > >
            > > > L: GA 03.003
            > > > T: 020-59 19 285
            > > > E: Jorg.Sander@m...
            > > >
            > > > -----Original Message-----
            > > > From: litbighor [mailto:lehuyluan@h...]
            > > > Sent: dinsdag 23 september 2003 11:08
            > > > To: psftdba@yahoogroups.com
            > > > Subject: PeopleSoft DBA Forum Web server stuck ???
            > > >
            > > >
            > > > Hi,
            > > >
            > > > I have a HRMS 8.3 Tools 8.19.06 on HP-UX 11i 64 bits.
            > > > Webserv Weblogic ,Appserv, Procserv, Database Oracle is on the
            > same
            > > > host.
            > > > (logical 3 tiers)
            > > >
            > > > I have a very bad problem with it :
            > > >
            > > > - The Webserv get stuck... I mean it works but when someone tries
            > to
            > > > log on (IE 6), it seems working and working.
            > > >
            > > > - I check the system with a top :
            > > > 1 process oracle working 25% CPU only. the machine is not
            > > overloaded !
            > > >
            > > > - I check the database and only one SQL select :
            > > > SELECT DISTINCT A.EMPLID , A.NAME , A.COURSE , A.SESSION_NBR ,
            > > > A.COURSE_TITLE ,
            > > > A.COURSE_END_DT FROM PS_SPITRN_SACST_VW A WHERE (A.COURSE IN (
            > > SELECT
            > > > B.COURSE FROM PS_SPITRN_STG_SECU B WHERE (B.BUSINESS_UNIT=(
            > SELECT
            > > > C.BUSINESS_UNIT FROM PS_OPR_DEF_TBL_HR C WHERE C.OPRCLASS=(
            > SELECT
            > > > E.OPRCLASS FROM PSOPRDEFN E WHERE E.OPRID='DAG')) OR
            > > > B.BUSINESS_UNIT='ST'))) ORDER BY EMPLID, NAME, COURSE,
            > SESSION_NBR,
            > > > COURSE_TITLE
            > > >
            > > > - No update or delete
            > > > - There's no lock at all !
            > > >
            > > > - I decided to kill the session :
            > > > and then at this instant, the browser get connected to
            > Peoplesoft !!
            > > >
            > > > It's unbelievable !
            > > > How can I prevent it ?
            > > > Do you have this kind of problem ?
            > > >
            > > > Thanks.
            > > >
            > > >
            > > >
            > > >
            > > >
            > > >
            > > >
            > > >
            > > >
            > > >
            > > >
            > > > Yahoo! Groups Sponsor
            > > >
            > > > ADVERTISEMENT
            > > >
            > >
            > < http://rd.yahoo.com/M=194081.3897168.5135684.1261774/D=egroupweb/S=17
            > >
            > 07698825:HM/A=1706996/R=0/SIG=11p5b9ris/* http://www.ediets.com/start.c
            > > fm?code=30509&media=atkins> click here
            > > > < http://us.adserver.yahoo.com/l?
            > >
            > M=194081.3897168.5135684.1261774/D=egroupmail/S=:HM/A=1706996/rand=218
            > > 369256>
            > > >
            > > > To unsubscribe from this group, send an email to:
            > > > psftdba-unsubscribe@yahoogroups.com
            > > >
            > > > The PeopleSoft DBA Forum is managed by Go-Faster Consultancy Ltd.
            > > http://www.go-faster.co.uk
            > > >
            > > > Your use of Yahoo! Groups is subject to the Yahoo! Terms of
            > Service
            > > < http://docs.yahoo.com/info/terms/> .
            > > >
            > > >
            > > >
            > > >
            > > > -----------------------------------------------------------------
            > > > ATTENTION:
            > > > The information in this electronic mail message is private and
            > > > confidential, and only intended for the addressee. Should you
            > > > receive this message by mistake, you are hereby notified that
            > > > any disclosure, reproduction, distribution or use of this
            > > > message is strictly prohibited. Please inform the sender by
            > > > reply transmission and delete the message without copying or
            > > > opening it.
            > > >
            > > > Messages and attachments are scanned for all viruses known.
            > > > If this message contains password-protected attachments, the
            > > > files have NOT been scanned for viruses by the ING mail domain.
            > > > Always scan attachments before opening them.
            > > > -----------------------------------------------------------------
            >
            >
            >
            >
            > Yahoo! Groups Sponsor
            >
            > ADVERTISEMENT
            >
            <http://rd.yahoo.com/M=194081.3897168.5135684.1261774/D=egroupweb/S=1707698=
            825:HM/A=1706996/R=0/SIG=11p5b9ris/*http://www.ediets.com/start.cfm?code=305=
            09&media=atkins>
            click here
            >
            <http://us.adserver.yahoo.com/l?M=194081.3897168.5135684.1261774/D=egroupma=
            il/S=:HM/A=1706996/rand=770966291>

            >
            > To unsubscribe from this group, send an email to:
            > psftdba-unsubscribe@yahoogroups.com
            >
            > The PeopleSoft DBA Forum is managed by Go-Faster Consultancy Ltd.
            http://www.go-faster.co.uk
            >
            > Your use of Yahoo! Groups is subject to the Yahoo! Terms of Service
            <http://docs.yahoo.com/info/terms/> .
          • litbighor
            Yes you are right. There s heavy CPU load. ... you have at least a CPU overload. ... (v$session) ... -- ... IDLE ) ... IDLE ) ... IDLE ) ... IDLE ) ... IDLE )
            Message 5 of 12 , Sep 25, 2003
            • 0 Attachment
              Yes you'are right. There's heavy CPU load.



              --- In psftdba@yahoogroups.com, <Jorg.Sander@m...> wrote:
              > I do not know what your appservers are doing but my feeling is that
              you have at least a CPU overload.
              > May be I am blind but what about these system percentages?
              >
              > CPU LOAD USER NICE SYS IDLE BLOCK SWAIT INTR SSYS
              > 0 1.47 15.2% 0.0% 84.8% 0.0% 0.0% 0.0% 0.0% 0.0%
              > 1 1.59 15.9% 0.0% 84.1% 0.0% 0.0% 0.0% 0.0% 0.0%
              > --- ---- ----- ----- ----- ----- ----- ----- ----- -----
              > avg 1.53 15.5% 0.0% 84.5% 0.0% 0.0% 0.0% 0.0% 0.0%
              >
              >
              > Met vriendelijke groet/Kind regards,
              >
              > Jörg Sander
              >
              > ING Nederland
              > OPS&IT/CC/GS/ccHR/Infrastructuur
              >
              > L: GA 03.003
              > T: 020-59 19 285
              > E: Jorg.Sander@m...
              >
              > -----Original Message-----
              > From: litbighor [mailto:lehuyluan@h...]
              > Sent: donderdag 25 september 2003 11:37
              > To: psftdba@yahoogroups.com
              > Subject: Re: PeopleSoft DBA Forum Web server stuck ???
              >
              >
              > Hi,
              >
              > The problem is back again but this time there's no ACTIVE
              (v$session)
              > sql sessions
              >
              > See that :
              >
              > > Prog Name Queue Name Grp Name ID RqDone Load Done
              > Current Service
              > --------- ---------- -------- -- ------ --------- -------
              --
              > ------
              > JSL 00095.00200 JSLGRP 200 0 0 (
              IDLE )
              > BBL 45837 HRINT 0 0 0 (
              IDLE )
              > PSAPPSRV APPQ APPSRV 1 558 27900 ICPanel
              > PSAPPSRV APPQ APPSRV 2 612 30600 ICPanel
              > PSAPPSRV APPQ APPSRV 3 2353 117650 ICPanel
              > JREPSVR 00094.00250 JREPGRP 250 9 450 (
              IDLE )
              > WSL 00001.00020 BASE 20 0 0 (
              IDLE )
              > PSSAMSRV SAMQ APPSRV 100 0 0 (
              IDLE )
              >
              > >
              >
              >
              > > LMID User Name Client Name Time Status
              > Bgn/Cmmt/Abrt
              > --------------- --------------- --------------- -------- ------- ---
              --
              > --------
              > HRINT psoft WSH 18:50:42 IDLE
              0/0/0
              > HRINT psoft JSH 18:50:42 IDLE
              0/0/0
              > HRINT SKI 147.98.102.33 0:12:21 IDLE/W
              0/0/0
              > HRINT JBV 147.98.102.6 0:41:46 IDLE/W
              0/0/0
              > HRINT VEBESC1 147.98.102.6 0:25:47 BUSY/W
              0/0/0
              > HRINT DAG 147.98.102.32 0:49:39 BUSY/W
              0/0/0
              > HRINT DAG 147.98.102.32 0:13:04 IDLE/W
              0/0/0
              > HRINT SKI 147.98.102.33 0:09:09 BUSY/W
              0/0/0
              > HRINT SKI 147.98.102.33 0:09:12 BUSY/W
              0/0/0
              > HRINT DAG 147.98.102.32 0:01:54 BUSY/W
              0/0/0
              > HRINT psoft tmadmin 0:00:00 IDLE
              0/0/0
              >
              > >
              >
              > > Prog Name Queue Name # Serve Wk Queued # Queued Ave.
              Len
              > Machine
              > --------- ------------------- --------- -------- --------
              --
              > -----
              > PSAPPSRV APPQ 3 - 14 -

              > xxx
              > WSL 00001.00020 1 - 0 -

              > xxx
              > JSL 00095.00200 1 - 0 -

              > xxx
              > BBL 45837 1 - 0 -

              > xxx
              > PSSAMSRV SAMQ 1 - 0 -

              > xxx
              > JREPSVR 00094.00250 1 - 0 -

              > xxx
              > >
              >
              >
              > System: XXX Thu Sep 25
              > 10:36:20 2003
              > Load averages: 1.53, 1.55, 1.55
              > 252 processes: 232 sleeping, 20 running
              > Cpu states:
              > CPU LOAD USER NICE SYS IDLE BLOCK SWAIT INTR SSYS
              > 0 1.47 15.2% 0.0% 84.8% 0.0% 0.0% 0.0% 0.0% 0.0%
              > 1 1.59 15.9% 0.0% 84.1% 0.0% 0.0% 0.0% 0.0% 0.0%
              > --- ---- ----- ----- ----- ----- ----- ----- ----- -----
              > avg 1.53 15.5% 0.0% 84.5% 0.0% 0.0% 0.0% 0.0% 0.0%
              >
              > Memory: 1273676K (885080K) real, 2099208K (1501556K) virtual,
              46984K
              > free Page# 1/11
              >
              > CPU TTY PID USERNAME PRI NI SIZE RES STATE TIME %WCPU %
              > CPU COMMAND
              > 0 pts/ta 14022 psoft 241 20 157M 90376K run 948:32 87.12
              > 86.96 PSAPPSRV
              > 0 pts/ta 14035 psoft 241 20 163M 93332K run 943:33 56.47
              > 56.37 PSAPPSRV
              > 1 pts/ta 16347 psoft 241 20 144M 75080K run 55:11 54.39
              > 54.29 PSAPPSRV
              > 1 pts/tb 14296 psoft 152 20 264M 87724K run 2:57 0.61
              > 0.61 java
              > 0 ? 36 root 152 20 6464K 6464K run 39:58 0.40
              > 0.39 vxfsd
              > 1 pts/ta 23177 psoft 178 20 21188K 824K run 0:00 0.46
              > 0.36 top
              >
              > No CPU overloading
              > No active SQL sessions...
              > No swapping...
              >
              > What are doing the PSAPPSRV process : there's no sql active ?
              >
              > I really don't understand.
              >
              >
              > --- In psftdba@yahoogroups.com, "litbighor" <lehuyluan@h...> wrote:
              > > Hi,
              > >
              > > You're right.
              > > I had Min Instances=1 and Max Instances=3.
              > > During the non-access, I have 1 in the App Serv Queue and only 1
              > App
              > > Serv process PSAPPSRV.
              > >
              > > I change Min Instances=2 then there's no problem now.
              > >
              > > But why the PSAPPSRV didn't spawn (max=3) ?
              > >
              > > Thanks.
              > >
              > > --- In psftdba@yahoogroups.com, <Jorg.Sander@m...> wrote:
              > > > Not that I know a real sollution to your problem. But what
              about
              > > the appserver. It sounds like whether you have only one
              psappserver
              > > handler there?
              > > > Is spawning enabled? Seems like whether this one SQL is
              blokking
              > > your appserver handler. Do you see requests in the appserver
              queue?
              > > >
              > > >
              > > > Met vriendelijke groet/Kind regards,
              > > >
              > > > Jörg Sander
              > > >
              > > > ING Nederland
              > > > OPS&IT/CC/GS/ccHR/Infrastructuur
              > > >
              > > > L: GA 03.003
              > > > T: 020-59 19 285
              > > > E: Jorg.Sander@m...
              > > >
              > > > -----Original Message-----
              > > > From: litbighor [mailto:lehuyluan@h...]
              > > > Sent: dinsdag 23 september 2003 11:08
              > > > To: psftdba@yahoogroups.com
              > > > Subject: PeopleSoft DBA Forum Web server stuck ???
              > > >
              > > >
              > > > Hi,
              > > >
              > > > I have a HRMS 8.3 Tools 8.19.06 on HP-UX 11i 64 bits.
              > > > Webserv Weblogic ,Appserv, Procserv, Database Oracle is on the
              > same
              > > > host.
              > > > (logical 3 tiers)
              > > >
              > > > I have a very bad problem with it :
              > > >
              > > > - The Webserv get stuck... I mean it works but when someone
              tries
              > to
              > > > log on (IE 6), it seems working and working.
              > > >
              > > > - I check the system with a top :
              > > > 1 process oracle working 25% CPU only. the machine is not
              > > overloaded !
              > > >
              > > > - I check the database and only one SQL select :
              > > > SELECT DISTINCT A.EMPLID , A.NAME , A.COURSE , A.SESSION_NBR ,
              > > > A.COURSE_TITLE ,
              > > > A.COURSE_END_DT FROM PS_SPITRN_SACST_VW A WHERE (A.COURSE IN (
              > > SELECT
              > > > B.COURSE FROM PS_SPITRN_STG_SECU B WHERE (B.BUSINESS_UNIT=(
              > SELECT
              > > > C.BUSINESS_UNIT FROM PS_OPR_DEF_TBL_HR C WHERE C.OPRCLASS=(
              > SELECT
              > > > E.OPRCLASS FROM PSOPRDEFN E WHERE E.OPRID='DAG')) OR
              > > > B.BUSINESS_UNIT='ST'))) ORDER BY EMPLID, NAME, COURSE,
              > SESSION_NBR,
              > > > COURSE_TITLE
              > > >
              > > > - No update or delete
              > > > - There's no lock at all !
              > > >
              > > > - I decided to kill the session :
              > > > and then at this instant, the browser get connected to
              > Peoplesoft !!
              > > >
              > > > It's unbelievable !
              > > > How can I prevent it ?
              > > > Do you have this kind of problem ?
              > > >
              > > > Thanks.
              > > >
              > > >
              > > >
              > > >
              > > >
              > > >
              > > >
              > > >
              > > >
              > > >
              > > >
              > > > Yahoo! Groups Sponsor
              > > >
              > > > ADVERTISEMENT
              > > >
              > >
              > <
              http://rd.yahoo.com/M=194081.3897168.5135684.1261774/D=egroupweb/S=17
              > >
              > 07698825:HM/A=1706996/R=0/SIG=11p5b9ris/*
              http://www.ediets.com/start.c
              > > fm?code=30509&media=atkins> click here
              > > > < http://us.adserver.yahoo.com/l?
              > >
              >
              M=194081.3897168.5135684.1261774/D=egroupmail/S=:HM/A=1706996/rand=218
              > > 369256>
              > > >
              > > > To unsubscribe from this group, send an email to:
              > > > psftdba-unsubscribe@yahoogroups.com
              > > >
              > > > The PeopleSoft DBA Forum is managed by Go-Faster Consultancy
              Ltd.
              > > http://www.go-faster.co.uk
              > > >
              > > > Your use of Yahoo! Groups is subject to the Yahoo! Terms of
              > Service
              > > < http://docs.yahoo.com/info/terms/> .
              > > >
              > > >
              > > >
              > > >
              > > > ----------------------------------------------------------------
              -
              > > > ATTENTION:
              > > > The information in this electronic mail message is private and
              > > > confidential, and only intended for the addressee. Should you
              > > > receive this message by mistake, you are hereby notified that
              > > > any disclosure, reproduction, distribution or use of this
              > > > message is strictly prohibited. Please inform the sender by
              > > > reply transmission and delete the message without copying or
              > > > opening it.
              > > >
              > > > Messages and attachments are scanned for all viruses known.
              > > > If this message contains password-protected attachments, the
              > > > files have NOT been scanned for viruses by the ING mail domain.
              > > > Always scan attachments before opening them.
              > > > ----------------------------------------------------------------
              -
              >
              >
              >
              >
              > Yahoo! Groups Sponsor
              >
              > ADVERTISEMENT
              >
              <http://rd.yahoo.com/M=194081.3897168.5135684.1261774/D=egroupweb/S=17
              07698825:HM/A=1706996/R=0/SIG=11p5b9ris/*http://www.ediets.com/start.c
              fm?code=30509&media=atkins> click here
              > <http://us.adserver.yahoo.com/l?
              M=194081.3897168.5135684.1261774/D=egroupmail/S=:HM/A=1706996/rand=770
              966291>
              >
              > To unsubscribe from this group, send an email to:
              > psftdba-unsubscribe@yahoogroups.com
              >
              > The PeopleSoft DBA Forum is managed by Go-Faster Consultancy Ltd.
              http://www.go-faster.co.uk
              >
              > Your use of Yahoo! Groups is subject to the Yahoo! Terms of Service
              <http://docs.yahoo.com/info/terms/> .
            • Y Fang
              One reason you saw App Server stuck with ICPanel and no SQL activity on the DB Server is because App Server is executing PeopleCode with each row returned by
              Message 6 of 12 , Sep 25, 2003
              • 0 Attachment
                One reason you saw App Server stuck with ICPanel and
                no SQL activity on the DB Server is because App Server
                is executing "PeopleCode" with each row returned by
                the Database...

                You should do a PIA trace and turn on for SQL & Pcode
                (probably list of program, and start of program) to
                see how much codes are being fired to determine where
                should you spend the tuning effort.

                ~y



                --- David Kurtz <david.kurtz@...> wrote:
                > I have seen this happen in a number of places, and I
                > don't know what
                > causes it.
                >
                > It is typical that the PSAPPSRV processes are shown
                > as handling a
                > process, as described in the thread. Though not all
                > of the processes
                > will be stuck. You only know they are stuck because
                > you run several
                > PSRs in tmadmin and the number of requests done does
                > not change (this
                > could be used to build a script to detect the
                > problem when it occurs).
                > If not corrected this problem will spread and
                > eventually all the
                > servers are stuck and the system grinds to a halt!
                >
                > > Prog Name Queue Name Grp Name ID RqDone
                > Load Done Current
                > Service
                > > --------- ---------- -------- -- ------
                > --------- ---------
                > > JSL 00095.00200 JSLGRP 200 0
                > 0 ( IDLE )
                > > BBL 45837 HRINT 0 0
                > 0 ( IDLE )
                > > PSAPPSRV APPQ APPSRV 1 558
                > 27900 ICPanel
                > > PSAPPSRV APPQ APPSRV 2 612
                > 30600 ICPanel
                > > PSAPPSRV APPQ APPSRV 3 2353
                > 117650 ICPanel
                > > JREPSVR 00094.00250 JREPGRP 250 9
                > 450 ( IDLE )
                > > WSL 00001.00020 BASE 20 0
                > 0 ( IDLE )
                > > PSSAMSRV SAMQ APPSRV 100 0
                > 0 ( IDLE )
                >
                > It is also typical that the servers are consuming
                > nearly 100% of a
                > CPU, and that it is all system time and not user
                > time. That is
                > interesting because it shows that it is a problem
                > with a system call
                > rather than user code.
                >
                > What I think may be happening is that one queues or
                > one of the
                > databases in the Bulletin board has become locked in
                > some way. When
                > messages are put onto or taken off a queue there is
                > a brief lock taken
                > So that server processes are trying to update it.
                > When a server is
                > restarted then a brief lock is placed on a database
                > in the bulletin
                > board that keeps a track of how many servers are
                > running.
                >
                > This also, deliberately, prevents more than server
                > being started at a
                > time. Hence there is a second variant of this
                > problem when, if the
                > recycle count is low or servers crash and have to be
                > restarted I have
                > also seen the status stuck as 'Restarting'.
                >
                > The queues are Unix IPC queues, and the bulletin
                > board is a shared
                > memory segment. All these structures are accessed
                > via the system
                > functions provides by the Unix kernel. So if one of
                > these calls gets
                > into a loop then it will be reported as system time.
                >
                > > CPU LOAD USER NICE SYS IDLE BLOCK
                > SWAIT INTR SSYS
                > > 0 1.47 15.2% 0.0% 84.8% 0.0% 0.0%
                > 0.0% 0.0% 0.0%
                > > 1 1.59 15.9% 0.0% 84.1% 0.0% 0.0%
                > 0.0% 0.0% 0.0%
                > > --- ---- ----- ----- ----- ----- -----
                > ----- ----- -----
                > > avg 1.53 15.5% 0.0% 84.5% 0.0% 0.0%
                > 0.0% 0.0% 0.0%
                >
                > The corrective action is to shutdown the server that
                > is holding the
                > lock (in tmadmin stop -g APPSRV -i <n>). You
                > usually have to force it
                > down (cntr c the shutdown and you will be asked if
                > you want to force
                > the shutdown), and sometimes you also have to kill
                > it by hand. Then
                > restart it (boot -g APPSRV -i <n>).
                >
                > I suspect that this may be caused by a memory leak
                > in the PeopleSoft
                > code, but I am not at all sure of that and I cannot
                > prove it. You
                > enable 'changetrace on' and send the trace in the
                > Tuxlog to
                > PeopleSoft, but it generates a lot of output and
                > will seriously impact
                > performance.
                >
                > _____________________________
                > David Kurtz
                > Go-Faster Consultancy Ltd.
                > tel: +44 7771 760660
                > fax: +44 7092 348865
                > mailto:david.kurtz@...
                > web: www.go-faster.co.uk
                > PeopleSoft DBA Forum:
                > http://groups.yahoo.com/group/psftdba
                >
                >
                >
                >
                >
                >
                > --- In psftdba@yahoogroups.com, <Jorg.Sander@m...>
                > wrote:
                > > I do not know what your appservers are doing but
                > my feeling is that
                > you have at least a CPU overload.
                > > May be I am blind but what about these system
                > percentages?
                > >
                > > CPU LOAD USER NICE SYS IDLE BLOCK
                > SWAIT INTR SSYS
                > > 0 1.47 15.2% 0.0% 84.8% 0.0% 0.0%
                > 0.0% 0.0% 0.0%
                > > 1 1.59 15.9% 0.0% 84.1% 0.0% 0.0%
                > 0.0% 0.0% 0.0%
                > > --- ---- ----- ----- ----- ----- -----
                > ----- ----- -----
                > > avg 1.53 15.5% 0.0% 84.5% 0.0% 0.0%
                > 0.0% 0.0% 0.0%
                > >
                > >
                > > Met vriendelijke groet/Kind regards,
                > >
                > > J顤g Sander
                > >
                > > ING Nederland
                > > OPS&IT/CC/GS/ccHR/Infrastructuur
                > >
                > > L: GA 03.003
                > > T: 020-59 19 285
                > > E: Jorg.Sander@m...
                > >
                > > -----Original Message-----
                > > From: litbighor [mailto:lehuyluan@h...]
                > > Sent: donderdag 25 september 2003 11:37
                > > To: psftdba@yahoogroups.com
                > > Subject: Re: PeopleSoft DBA Forum Web server stuck
                > ???
                > >
                > >
                > > Hi,
                > >
                > > The problem is back again but this time there's no
                > ACTIVE (v$session)
                > > sql sessions
                > >
                > > See that :
                > >
                > > > Prog Name Queue Name Grp Name ID
                > RqDone Load Done
                > > Current Service
                > > --------- ---------- -------- -- ------
                > --------- ---------
                > > ------
                > > JSL 00095.00200 JSLGRP 200 0
                > 0 ( IDLE )
                > > BBL 45837 HRINT 0 0
                > 0 ( IDLE )
                > > PSAPPSRV APPQ APPSRV 1 558
                > 27900 ICPanel
                > > PSAPPSRV APPQ APPSRV 2 612
                > 30600 ICPanel
                > > PSAPPSRV APPQ APPSRV 3 2353
                > 117650 ICPanel
                > > JREPSVR 00094.00250 JREPGRP 250 9
                > 450 ( IDLE )
                > > WSL 00001.00020 BASE 20 0
                > 0 ( IDLE )
                > > PSSAMSRV SAMQ APPSRV 100 0
                > 0 ( IDLE )
                > >
                > > >
                > >
                > >
                > > > LMID User Name Client Name
                > Time Status
                > > Bgn/Cmmt/Abrt
                > > --------------- --------------- ---------------
                > -------- ------- -----
                >
                === message truncated ===


                __________________________________
                Do you Yahoo!?
                The New Yahoo! Shopping - with improved product search
                http://shopping.yahoo.com
              • David Kurtz
                Sorry, I don t want this to sound like a put down, but I have to disagree with you. It is important to be able to distinguish a long running (but otherwise
                Message 7 of 12 , Sep 26, 2003
                • 0 Attachment
                  Sorry, I don't want this to sound like a put down, but I have to
                  disagree with you.

                  It is important to be able to distinguish a long running (but
                  otherwise normally executing) Tuxedo service with this scenario.

                  If the PSAPPSRV process was executing PeopleCode it would be
                  consuming CPU accounted as user time not system time.

                  If that PeopleCode were to execute SQL, the process would then be
                  waiting for a response from the database, and it would not be
                  consuming 100% of a CPU.

                  The reported high system CPU consumption is therefore not consistent
                  with the application server executing PeopleCode.




                  --- In psftdba@yahoogroups.com, Y Fang <yfang11@y...> wrote:
                  >
                  > One reason you saw App Server stuck with ICPanel and
                  > no SQL activity on the DB Server is because App Server
                  > is executing "PeopleCode" with each row returned by
                  > the Database...
                  >
                  > You should do a PIA trace and turn on for SQL & Pcode
                  > (probably list of program, and start of program) to
                  > see how much codes are being fired to determine where
                  > should you spend the tuning effort.
                  >
                  > ~y
                  >
                  >
                  >
                  > --- David Kurtz <david.kurtz@g...> wrote:
                  > > I have seen this happen in a number of places, and I
                  > > don't know what
                  > > causes it.
                  > >
                  > > It is typical that the PSAPPSRV processes are shown
                  > > as handling a
                  > > process, as described in the thread. Though not all
                  > > of the processes
                  > > will be stuck. You only know they are stuck because
                  > > you run several
                  > > PSRs in tmadmin and the number of requests done does
                  > > not change (this
                  > > could be used to build a script to detect the
                  > > problem when it occurs).
                  > > If not corrected this problem will spread and
                  > > eventually all the
                  > > servers are stuck and the system grinds to a halt!
                  > >
                  > > > Prog Name Queue Name Grp Name ID RqDone
                  > > Load Done Current
                  > > Service
                  > > > --------- ---------- -------- -- ------
                  > > --------- ---------
                  > > > JSL 00095.00200 JSLGRP 200 0
                  > > 0 ( IDLE )
                  > > > BBL 45837 HRINT 0 0
                  > > 0 ( IDLE )
                  > > > PSAPPSRV APPQ APPSRV 1 558
                  > > 27900 ICPanel
                  > > > PSAPPSRV APPQ APPSRV 2 612
                  > > 30600 ICPanel
                  > > > PSAPPSRV APPQ APPSRV 3 2353
                  > > 117650 ICPanel
                  > > > JREPSVR 00094.00250 JREPGRP 250 9
                  > > 450 ( IDLE )
                  > > > WSL 00001.00020 BASE 20 0
                  > > 0 ( IDLE )
                  > > > PSSAMSRV SAMQ APPSRV 100 0
                  > > 0 ( IDLE )
                  > >
                  > > It is also typical that the servers are consuming
                  > > nearly 100% of a
                  > > CPU, and that it is all system time and not user
                  > > time. That is
                  > > interesting because it shows that it is a problem
                  > > with a system call
                  > > rather than user code.
                  > >
                  > > What I think may be happening is that one queues or
                  > > one of the
                  > > databases in the Bulletin board has become locked in
                  > > some way. When
                  > > messages are put onto or taken off a queue there is
                  > > a brief lock taken
                  > > So that server processes are trying to update it.
                  > > When a server is
                  > > restarted then a brief lock is placed on a database
                  > > in the bulletin
                  > > board that keeps a track of how many servers are
                  > > running.
                  > >
                  > > This also, deliberately, prevents more than server
                  > > being started at a
                  > > time. Hence there is a second variant of this
                  > > problem when, if the
                  > > recycle count is low or servers crash and have to be
                  > > restarted I have
                  > > also seen the status stuck as 'Restarting'.
                  > >
                  > > The queues are Unix IPC queues, and the bulletin
                  > > board is a shared
                  > > memory segment. All these structures are accessed
                  > > via the system
                  > > functions provides by the Unix kernel. So if one of
                  > > these calls gets
                  > > into a loop then it will be reported as system time.
                  > >
                  > > > CPU LOAD USER NICE SYS IDLE BLOCK
                  > > SWAIT INTR SSYS
                  > > > 0 1.47 15.2% 0.0% 84.8% 0.0% 0.0%
                  > > 0.0% 0.0% 0.0%
                  > > > 1 1.59 15.9% 0.0% 84.1% 0.0% 0.0%
                  > > 0.0% 0.0% 0.0%
                  > > > --- ---- ----- ----- ----- ----- -----
                  > > ----- ----- -----
                  > > > avg 1.53 15.5% 0.0% 84.5% 0.0% 0.0%
                  > > 0.0% 0.0% 0.0%
                  > >
                  > > The corrective action is to shutdown the server that
                  > > is holding the
                  > > lock (in tmadmin stop -g APPSRV -i <n>). You
                  > > usually have to force it
                  > > down (cntr c the shutdown and you will be asked if
                  > > you want to force
                  > > the shutdown), and sometimes you also have to kill
                  > > it by hand. Then
                  > > restart it (boot -g APPSRV -i <n>).
                  > >
                  > > I suspect that this may be caused by a memory leak
                  > > in the PeopleSoft
                  > > code, but I am not at all sure of that and I cannot
                  > > prove it. You
                  > > enable 'changetrace on' and send the trace in the
                  > > Tuxlog to
                  > > PeopleSoft, but it generates a lot of output and
                  > > will seriously impact
                  > > performance.
                  > >
                  > > _____________________________
                  > > David Kurtz
                  > > Go-Faster Consultancy Ltd.
                  > > tel: +44 7771 760660
                  > > fax: +44 7092 348865
                  > > mailto:david.kurtz@g...
                  > > web: www.go-faster.co.uk
                  > > PeopleSoft DBA Forum:
                  > > http://groups.yahoo.com/group/psftdba
                  > >
                  > >
                  > >
                  > >
                  > >
                  > >
                  > > --- In psftdba@yahoogroups.com, <Jorg.Sander@m...>
                  > > wrote:
                  > > > I do not know what your appservers are doing but
                  > > my feeling is that
                  > > you have at least a CPU overload.
                  > > > May be I am blind but what about these system
                  > > percentages?
                  > > >
                  > > > CPU LOAD USER NICE SYS IDLE BLOCK
                  > > SWAIT INTR SSYS
                  > > > 0 1.47 15.2% 0.0% 84.8% 0.0% 0.0%
                  > > 0.0% 0.0% 0.0%
                  > > > 1 1.59 15.9% 0.0% 84.1% 0.0% 0.0%
                  > > 0.0% 0.0% 0.0%
                  > > > --- ---- ----- ----- ----- ----- -----
                  > > ----- ----- -----
                  > > > avg 1.53 15.5% 0.0% 84.5% 0.0% 0.0%
                  > > 0.0% 0.0% 0.0%
                  > > >
                  > > >
                  > > > Met vriendelijke groet/Kind regards,
                  > > >
                  > > > J顤g Sander
                  > > >
                  > > > ING Nederland
                  > > > OPS&IT/CC/GS/ccHR/Infrastructuur
                  > > >
                  > > > L: GA 03.003
                  > > > T: 020-59 19 285
                  > > > E: Jorg.Sander@m...
                  > > >
                  > > > -----Original Message-----
                  > > > From: litbighor [mailto:lehuyluan@h...]
                  > > > Sent: donderdag 25 september 2003 11:37
                  > > > To: psftdba@yahoogroups.com
                  > > > Subject: Re: PeopleSoft DBA Forum Web server stuck
                  > > ???
                  > > >
                  > > >
                  > > > Hi,
                  > > >
                  > > > The problem is back again but this time there's no
                  > > ACTIVE (v$session)
                  > > > sql sessions
                  > > >
                  > > > See that :
                  > > >
                  > > > > Prog Name Queue Name Grp Name ID
                  > > RqDone Load Done
                  > > > Current Service
                  > > > --------- ---------- -------- -- ------
                  > > --------- ---------
                  > > > ------
                  > > > JSL 00095.00200 JSLGRP 200 0
                  > > 0 ( IDLE )
                  > > > BBL 45837 HRINT 0 0
                  > > 0 ( IDLE )
                  > > > PSAPPSRV APPQ APPSRV 1 558
                  > > 27900 ICPanel
                  > > > PSAPPSRV APPQ APPSRV 2 612
                  > > 30600 ICPanel
                  > > > PSAPPSRV APPQ APPSRV 3 2353
                  > > 117650 ICPanel
                  > > > JREPSVR 00094.00250 JREPGRP 250 9
                  > > 450 ( IDLE )
                  > > > WSL 00001.00020 BASE 20 0
                  > > 0 ( IDLE )
                  > > > PSSAMSRV SAMQ APPSRV 100 0
                  > > 0 ( IDLE )
                  > > >
                  > > > >
                  > > >
                  > > >
                  > > > > LMID User Name Client Name
                  > > Time Status
                  > > > Bgn/Cmmt/Abrt
                  > > > --------------- --------------- ---------------
                  > > -------- ------- -----
                  > >
                  > === message truncated ===
                  >
                  >
                  > __________________________________
                  > Do you Yahoo!?
                  > The New Yahoo! Shopping - with improved product search
                  > http://shopping.yahoo.com
                Your message has been successfully submitted and would be delivered to recipients shortly.