PFI Workflow Failures

I'm going to start by apologizing. Not only am I new to Lawson, but I am also new to the company that I'm currently working for.

We are having a problem with Lawson which nobody here has been able to track down. Here is a rundown of the issue, as summed up by one of the application owners.

----------------------------------------------------------

"We have been experiencing several incidents with Lawson ProcessFlow Integrator workflow units not executing. This is causing significant impact on the business side, since the requisitions become 'locked' within the workflow approval process and are not visible to the next level for approval or completed to convert to purchase orders.

The occurrences of incidents appear to be associated with bulk activities within the workflow process, for example one approver performing the approval process for several requisitions at the same time. The symptom of the workflow stoppage is loss of PFI authority to access some objects on the system, such as IOS, folders, or SSL/SOP. Each incident has involved different objects, although the symptom of the problem is similar. One area we are looking at is a potential association with the System I disk migration change that was completed in production on 9/22/12. We were not experiencing any incidents of this nature prior to that time.

We also opened a vendor support incident with Infor (Lawson), case #6162847, to help resolve the incidents. They have provided some clean up tasks which are documented in the action items of this document; however, the PFI application is performing correctly, so the focus of our problem analysis has moved to the System I environment.

In attempts to resolve the permissions issues we initially attempted to stop and restart the Lawson application. However, this does not resolve the object authority problem. The only remedy is to perform a full IPL on the server."

----------------------------------------------------------

I will need to get a little clarification on the last two sentences, regarding whether they really have to IPL the iSeries after they experience the issue.

This is running on iOS v5r4. There was a disk migration around the same time the issue started happening. The server was using EMC DMX disks, but that disk subsystem has since been retired. The disks were migrated to internal disks in an io drawer, but disk io does not appear to be excessively high. Nobody is calling out any code changes around the same time the issue started.

Here is an excerpt from the WebSphere logs at the time of the error.

----------------------------------------------------------

2012-11-09 13:31:20,110 INFO [UIDef] getUIDefFileLoc called with prodline: LAWAPP9 token: AP30.7 language: default customFormID: null
2012-11-09 13:31:20,165 INFO [ErpTransactionAgent] processing transaction: LAWAPP9/AP30.7
2012-11-09 13:31:22,754 INFO [ErpTransactionAgent] processing transaction: LAWAPP9/AP30.7
2012-11-09 13:31:23,649 ERROR [SsoAuthenManagerImpl] error accessing SSO
com.lawson.lawsec.authen.SecurityAuthenException: Got an exception while sendRedirect.
at java.lang.Throwable.(Throwable.java:196)
at java.lang.Exception.(Exception.java:41)
at com.lawson.common.util.logging.ErrorException.(ErrorException.java:35)
at com.lawson.security.interfaces.GeneralLawsonSecurityException.(GeneralLawsonSecurityException.java:24)
at com.lawson.lawsec.authen.SecurityAuthenException.(SecurityAuthenException.java:9)
at com.lawson.lawsec.authen.LawsonWebAuthentication.assertForAuth(LawsonWebAuthentication.java:27)
at com.lawson.ios.authen.sso.SsoAuthenManagerImpl.isUserAuthenticated(SsoAuthenManagerImpl.java:40)
at com.lawson.ios.authen.SecureHttpServlet.getAuthenticatedRequest(SecureHttpServlet.java:75)
at com.lawson.servlet.Xpress.doGet(Xpress.java:105)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:736)
at com.lawson.ios.authen.SecureHttpServlet.service(SecureHttpServlet.java:48)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:851)
at com.ibm.ws.webcontainer.servlet.ServletWrapper.service(ServletWrapper.java:1096)
at com.ibm.ws.webcontainer.servlet.ServletWrapper.service(ServletWrapper.java:1075)
at com.ibm.ws.webcontainer.filter.WebAppFilterChain.doFilter(WebAppFilterChain.java:106)
at com.ibm.ws.webcontainer.filter.WebAppFilterChain._doFilter(WebAppFilterChain.java:75)
at com.ibm.ws.webcontainer.filter.WebAppFilterManager.doFilter(WebAppFilterManager.java:786)
at com.ibm.ws.webcontainer.filter.WebAppFilterManager.doFilter(WebAppFilterManager.java:680)
at com.ibm.ws.webcontainer.servlet.ServletWrapper.handleRequest(ServletWrapper.java:320)
at com.ibm.ws.wswebcontainer.servlet.ServletWrapper.handleRequest(ServletWrapper.java:405)
at com.ibm.ws.webcontainer.servlet.CacheServletWrapper.handleRequest(CacheServletWrapper.java:81)
at com.ibm.ws.webcontainer.WebContainer.handleRequest(WebContainer.java:619)
at com.ibm.ws.wswebcontainer.WebContainer.handleRequest(WebContainer.java:1429)
at com.ibm.ws.webcontainer.channel.WCChannelLink.ready(WCChannelLink.java:117)
at com.ibm.ws.http.channel.inbound.impl.HttpInboundLink.handleDiscrimination(HttpInboundLink.java:398)
at com.ibm.ws.http.channel.inbound.impl.HttpInboundLink.handleNewInformation(HttpInboundLink.java:298)
at com.ibm.ws.http.channel.inbound.impl.HttpICLReadCallback.complete(HttpICLReadCallback.java:85)
at com.ibm.ws.tcp.channel.impl.WorkQueueManager.requestComplete(WorkQueueManager.java:532)
at com.ibm.ws.tcp.channel.impl.WorkQueueManager.attemptIO(WorkQueueManager.java:583)
at com.ibm.ws.tcp.channel.impl.WorkQueueManager.workerRun(WorkQueueManager.java:973)
at com.ibm.ws.tcp.channel.impl.WorkQueueManager$Worker.run(WorkQueueManager.java:1063)
at com.ibm.ws.util.ThreadPool$Worker.run(ThreadPool.java:1485)
2012-11-09 13:31:23,698 ERROR [Xpress]
com.lawson.ios.authen.AuthenException: AUTHEN_ERROR
at java.lang.Throwable.(Throwable.java:218)
at java.lang.Exception.(Exception.java:59)
at com.lawson.rdtech.shared.action.exception.ActionException.(ActionException.java:41)
at com.lawson.ios.agent.AgentException.(AgentException.java:79)
at com.lawson.ios.agent.AgentException.(AgentException.java:63)
at com.lawson.ios.authen.AuthenException.(AuthenException.java:17)
at com.lawson.ios.authen.sso.SsoAuthenManagerImpl.isUserAuthenticated(SsoAuthenManagerImpl.java:40)
at com.lawson.ios.authen.SecureHttpServlet.getAuthenticatedRequest(SecureHttpServlet.java:75)
at com.lawson.servlet.Xpress.doGet(Xpress.java:105)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:736)
at com.lawson.ios.authen.SecureHttpServlet.service(SecureHttpServlet.java:48)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:851)
at com.ibm.ws.webcontainer.servlet.ServletWrapper.service(ServletWrapper.java:1096)
at com.ibm.ws.webcontainer.servlet.ServletWrapper.service(ServletWrapper.java:1075)
at com.ibm.ws.webcontainer.filter.WebAppFilterChain.doFilter(WebAppFilterChain.java:106)
at com.ibm.ws.webcontainer.filter.WebAppFilterChain._doFilter(WebAppFilterChain.java:75)
at com.ibm.ws.webcontainer.filter.WebAppFilterManager.doFilter(WebAppFilterManager.java:786)
at com.ibm.ws.webcontainer.filter.WebAppFilterManager.doFilter(WebAppFilterManager.java:680)
at com.ibm.ws.webcontainer.servlet.ServletWrapper.handleRequest(ServletWrapper.java:320)
at com.ibm.ws.wswebcontainer.servlet.ServletWrapper.handleRequest(ServletWrapper.java:405)
at com.ibm.ws.webcontainer.servlet.CacheServletWrapper.handleRequest(CacheServletWrapper.java:81)
at com.ibm.ws.webcontainer.WebContainer.handleRequest(WebContainer.java:619)
at com.ibm.ws.wswebcontainer.WebContainer.handleRequest(WebContainer.java:1429)
at com.ibm.ws.webcontainer.channel.WCChannelLink.ready(WCChannelLink.java:117)
at com.ibm.ws.http.channel.inbound.impl.HttpInboundLink.handleDiscrimination(HttpInboundLink.java:398)
at com.ibm.ws.http.channel.inbound.impl.HttpInboundLink.handleNewInformation(HttpInboundLink.java:298)
at com.ibm.ws.http.channel.inbound.impl.HttpICLReadCallback.complete(HttpICLReadCallback.java:85)
at com.ibm.ws.tcp.channel.impl.WorkQueueManager.requestComplete(WorkQueueManager.java:532)
at com.ibm.ws.tcp.channel.impl.WorkQueueManager.attemptIO(WorkQueueManager.java:583)
at com.ibm.ws.tcp.channel.impl.WorkQueueManager.workerRun(WorkQueueManager.java:973)
at com.ibm.ws.tcp.channel.impl.WorkQueueManager$Worker.run(WorkQueueManager.java:1063)
at com.ibm.ws.util.ThreadPool$Worker.run(ThreadPool.java:1485)
Caused by: com.lawson.lawsec.authen.SecurityAuthenException: Got an exception while sendRedirect.
at java.lang.Throwable.(Throwable.java:196)
at java.lang.Exception.(Exception.java:41)
at com.lawson.common.util.logging.ErrorException.(ErrorException.java:35)
at com.lawson.security.interfaces.GeneralLawsonSecurityException.(GeneralLawsonSecurityException.java:24)
at com.lawson.lawsec.authen.SecurityAuthenException.(SecurityAuthenException.java:9)
at com.lawson.lawsec.authen.LawsonWebAuthentication.assertForAuth(LawsonWebAuthentication.java:27)
... 26 more
2012-11-09 13:31:24,272 INFO [UIDef] getUIDefFileLoc called with prodline: LAWAPP9 token: AP30.7 language: default customFormID: null
2012-11-09 13:31:24,320 INFO [ErpTransactionAgent] processing transaction: LAWAPP9/AP30.7
2012-11-09 13:31:25,694 INFO [FormRuleCollection] triggerValue=ATX, ruleType=field-exit; all rules secured

----------------------------------------------------------

Any thoughts would be appreciated. I will get some clarification on the impact and resolution.

Thank you in advance!