Use Perl to query DME via HTTP

Sort:
You are not authorized to post a reply.
Author
Messages
jeremy.zerr
Advanced Member
Posts: 23
Advanced Member

    I haven't really found much information out there about how to use perl to access Lawson data through the DME's, so I figured I would share with you what I know.

    Sometimes, reporting calls for more powerful measures than excel can handle through the Office Add-ins, and well, I know that a scripting language like perl is more than capable through my years of prior experience doing data analysis for a semiconductor company.  Sometimes, 65536 data records is a limitation of Excel that eliminates it as a solution option when trying to solve a problem.  Bring on perl!

    So my goal was to figure out how to use perl to query Lawson data through the DME that is already in place.  This is important in our environment where our Lawson system is hosted, so we don't have the database connections or server-side programming that in-house Lawson setups would have.  So this means that I need to use HTTP access from perl to navigate through the HTTP basic authentication to query using the DME.  This is the only option that we have that would use Lawson security, as our ODBC connection is an all-access connection.

    So let me show you how to use perl to whip the Lawson data into shape.

    Step 1)

    Find a DME query.  Easy.  Just use the Lawson Office Add-ins to develop the query, run the query once, click on the little magnifying glass at the top of the Office Add-ins tool to get the full DME call.  Done!

    Step 2)

    Very simple perl code.  For this example, pulling Company, Employee, first and last name from the EMPLOYEE table in our PROD environment via the DME query.

    #!/usr/bin/perl
    use strict;
    use LWP::UserAgent;

    Next goes your DME query that you pulled from the Office add-ins.


    # copy and paste the URL directly from the Office Add-ins Query Wizard
    # IMPORTANT: if your server has a port, you NEED to add it in, otherwise the auth won't work
    my $simpleURL = "http://my.lawson.server.com:30077/cgi-lawson/dme.exe?PROD=PROD&FILE=EMPLOYEE&INDEX=EMPSET1&KEY=1&FIELD=COMPANY;EMPLOYEE;FIRST%2DNAME;LAST%2DNAME&MAX=600&OUT=CSV&DELIM=%09&NOHEADER=TRUE";

    Next, initialize the perl LWP::UserAgent module to do the HTTP request.  If you don't know your authentication realm, copy and paste the DME query into a blank web browser window, hit enter, and see what the prompt says.  Or just run this script, and an error will pop up that shows you, more details on that down below.


    my $ua = LWP::UserAgent->new;
    # set the basic HTTP auth credentials
    # arguments are server:port, authentication realm, username => password
    $ua->credentials('my.lawson.server.com:30077','Lawson Restricted Access','username'=>'password');
    my $response = $ua->get($simpleURL);

    Now we will verify the response, and print out an error that will contain the reason for failure.


    if($response->is_success) {
      print $response->content;
    }
    else {
      # this will print out any errors
      # IMPORTANT: This also will tell you what your auth realm is if you don't know it
      die "Error: ", $response->header('WWW-Authenticate') || 'Error accessing', "\n", $response->status_line, "\n at $url\n Aborting";
    }

     

    Here is the full code listing for you copy and pasters.


    #!/usr/bin/perl
    use strict;
    use LWP::UserAgent;

    # copy and paste the URL directly from the Office Add-ins Query Wizard
    # IMPORTANT: if your server has a port, you NEED to add it in, otherwise the auth won't work
    my $simpleURL = "http://my.lawson.server.com:30077/cgi-lawson/dme.exe?PROD=PROD&FILE=EMPLOYEE&INDEX=EMPSET1&KEY=1&FIELD=COMPANY;EMPLOYEE;FIRST%2DNAME;LAST%2DNAME&MAX=600&OUT=CSV&DELIM=%09&NOHEADER=TRUE";

    my $ua = LWP::UserAgent->new;
    # set the basic HTTP auth credentials
    # arguments are server:port, authentication realm, username => password
    $ua->credentials('my.lawson.server.com:30077','Lawson Restricted Access','username'=>'password');
    my $response = $ua->get($simpleURL);

    if($response->is_success) {
      print $response->content;
    }
    else {
      # this will print out any errors
      # IMPORTANT: This also will tell you what your auth realm is if you don't know it
      die "Error: ", $response->header('WWW-Authenticate') || 'Error accessing', "\n", $response->status_line, "\n at $url\n Aborting";
    }

    ScottMullins
    New Member
    Posts: 1
    New Member
      Jeremy,

      We struggle with these Excel Query Wizard DME's all the time.  For example, some query tool wiz from our accounting dept. will whip up a DME and ask us (Lawson Admins) to automate it.

      It takes forever because we aren't using Cognos or Crystal Reports.  We have to painstakingly build the Oracle SQL by hand...often not knowing the relationship between the tables.

      This can take several hours or even a couple of days to figure out the relationships and get the report right.  I think your perl script could help greatly.  We'll give it a go and let you know how it turns out.

      Regards.
      jeremy.zerr
      Advanced Member
      Posts: 23
      Advanced Member
        Scott,

        I wish you best of luck. I know in our development environment, we don't have any linux/unix machines that we have access to that would be able to fire off automated jobs using cron. So I do all my perl development on my windows box. But the good thing is, I can embed running the perl script inside of a batch file. Which I can then schedule using the Scheduled Tasks in the Control Panels. So I guess its good to know that whether a company is lucky enough to have linux/unix, or only has Windows, there are still automation capabilities with both.

        Good luck,
        Jeremy Zerr
        http://www.zerrtech.com
        Greg Moeller
        Veteran Member
        Posts: 1498
        Veteran Member
          You may be able to take advantage of cygwin available here:
          http://www.cygwin.com/ if you want linux-like functionality in Windows.

          Cheers,
          -Greg
          jeremy.zerr
          Advanced Member
          Posts: 23
          Advanced Member
            You guys must be lucky enough to be able to install your own programs on your own computer at work.  We don't have the luxury.  Gotta be an admin or find a program that doesn't need admin rights.  Trust me, I tried to install cygwin already.  It needs admin rights.  Perl on the other hand can be installed without admin rights.  Whew was I glad.

            Jeremy Zerr
            http://www.zerrtech.com
            You are not authorized to post a reply.