PrevPrev Go to previous topic
NextNext Go to next topic
Last Post 01/19/2015 1:19 PM by  Peter O
Mass transaction upload - TM to S3 interface
 9 Replies
Sort:
You are not authorized to post a reply.
Page 1 of 212 > >>
Author Messages
bearcat32
Hr Apps Admin
TriHealth
Basic Member
(22 points)
Basic Member
Posts:12


Send Message:

--
09/11/2014 7:24 PM
    What is your approach to uploading mass transactions (ie Merit or pay rate changes) into TM and having them reflect in S3? After a few tests it seems the delivered flows take hours/days to simply interface the data to the LT holding tables. There has to be a more efficient solution.

    Thanks for any advice.
    Srini Rao
    Private
    Private
    Veteran Member
    (294 points)
    Veteran Member
    Posts:138


    Send Message:

    --
    09/11/2014 9:13 PM
    Hello, Last week we processed 9700 pay rate change transactions and it took 53 minutes to export to LT11.

    You check couple of things...
    1. Change process flow's log levels to "No Debug"
    2. Check out if you have any user exists on Lt11.
    Woozy
    Private
    Private
    Veteran Member
    (3490 points)
    Veteran Member
    Posts:708


    Send Message:

    --
    09/12/2014 9:11 AM
    The interface is really the best and only option that won't cause headaches down the road.

    Srini Rao is absolutely correct. I'm guessing you have logging turned on, which greatly decreases performance. We keep logging completely off for all of our batch flows unless there is something very specific we are troubleshooting - and then only with a very small batch.

    We do turn on some logging for short duration single record flows - i.e. Action flows - so that we track what happened in each event.

    Good Luck!
    Kelly Meade
    J. R. Simplot Company
    Boise, ID
    bearcat32
    Hr Apps Admin
    TriHealth
    Basic Member
    (22 points)
    Basic Member
    Posts:12


    Send Message:

    --
    09/12/2014 11:32 AM
    Thank you both very much for your responses.
    If I may ask a few additional questions in terms of your process.

    *Do you use spreadsheet designer to load the actual pay rates to TM or another utility?

    *Do you commit the data to TM in batches (e.g 1,000 at a time) or in a single load (e.g. all 9,700 transactions at once)?

    *Do you use process immediately for these or do you run the export flows to interface all the records under one work unit?

    Thanks again!
    Woozy
    Private
    Private
    Veteran Member
    (3490 points)
    Veteran Member
    Posts:708


    Send Message:

    --
    09/12/2014 1:11 PM
    In our case, we generally use LSD when we need to do these loads. Sometimes we do them all at once, and sometimes we break them up - but this is usually because of the data source or calculation differences rather than performance reasons. It isn't unusual for us to upload 5000+ records at once with LSD, and we frequenly do tens of thousands - though it is very slow.

    Our TM to S3 interface runs on a schedule twice-a-day, and we generally don't run it manually, even for these types of processes. We just let the interface process pick up whatever is available when it runs.
    Kelly Meade
    J. R. Simplot Company
    Boise, ID
    You are not authorized to post a reply.
    Page 1 of 212 > >>