High speed "gigantic data" XMLSERVICE run it here ...

High speed "gigantic data" XMLSERVICE run it here ...

Postby rangercairns on Tue Nov 20, 2012 10:55 pm

You ask ... we deliver 30,000 records less than 2 seconds ...

Alan will have to decide how best to wrapper the "big data" PHP Toolkit API (just raw XML).
I will post xmlservice-1.7.5 when Alan and I are closer to complete testing ...

Run it -> http://www.youngiprofessionals.com/wiki ... bigboy.php
View it -> http://www.youngiprofessionals.com/wiki ... oy.src.php

==========
Sample output
===========
Calling Big Boy PGM
30000 Records Input/Ouput

Welcome aboard xmlservice toolkit hacker crew, flying 30000 records round trip.

Your flight time today: Time (loop=1) total=1.96 sec (0.51 calls/sec) (1.955565 sec per call)
rangercairns
 
Posts: 216
Joined: Fri Jul 24, 2009 6:28 pm

Re: High speed "gigantic data" XMLSERVICE run it here ...

Postby rangercairns on Tue Nov 20, 2012 11:57 pm

Looks like increasing number content records performance curve is fairly linear ... thanks to DB2 best product on IBM i.

Welcome aboard xmlservice toolkit hacker crew, flying 100000 records round trip.
Your flight time today: Time (loop=1) total=7.41 sec (0.13 calls/sec) (7.410856 sec per call)
100,000 records run it -> http://www.youngiprofessionals.com/wiki ... boy100.php
100,000 records view it -> http://www.youngiprofessionals.com/wiki ... 00.src.php
rangercairns
 
Posts: 216
Joined: Fri Jul 24, 2009 6:28 pm

Re: High speed "gigantic data" XMLSERVICE run it here ...

Postby rangercairns on Wed Nov 21, 2012 12:20 am

Running 2-tier Linux laptop to IBM i over DB2 Connect DRDA also produces similar good results ...

adc@cairns:~/src/zmaster/zmaster_tool/tests$ php xxbigboy.php 30000
<h1>Calling Big Boy PGM</h1>
<h1>30000 Records Input/Ouput</h1>
<p>Welcome aboard xmlservice toolkit hacker crew, flying 30000 records round trip.</p>
<p>Your flight time today: Time (loop=1) total=3.89 sec (0.26 calls/sec) (3.893274 sec per call)
</p>
</p>
9.1:B29980:29980.1:B29981:29981.1:B29982:29982.1:B29983:29983.1:B29984:29984.1:B29985:29985.1:B29986:29986.1:B29987:29987.1:B29988:29988.1:B29989:29989.1:B29990:29990.1:B29991:29991.1:B29992:29992.1:B29993:29993.1:B29994:29994.1:B29995:29995.1:B29996:29996.1:B29997:29997.1:B29998:29998.1:B29999:29999.1:B30000:30000.1:</records>
</parm>
<return>
<data type='10i0'>0</data>
</return>
</pgm>
</script>

adc@cairns:~/src/zmaster/zmaster_tool/tests$ php xxbigboy.php 50000
<h1>Calling Big Boy PGM</h1>
<h1>50000 Records Input/Ouput</h1>
<p>Welcome aboard xmlservice toolkit hacker crew, flying 50000 records round trip.</p>
<p>Your flight time today: Time (loop=1) total=6.37 sec (0.16 calls/sec) (6.365370 sec per call)
</p>
</p>
9.1:B49980:49980.1:B49981:49981.1:B49982:49982.1:B49983:49983.1:B49984:49984.1:B49985:49985.1:B49986:49986.1:B49987:49987.1:B49988:49988.1:B49989:49989.1:B49990:49990.1:B49991:49991.1:B49992:49992.1:B49993:49993.1:B49994:49994.1:B49995:49995.1:B49996:49996.1:B49997:49997.1:B49998:49998.1:B49999:49999.1:B50000:50000.1:</records>
</parm>
<return>
<data type='10i0'>0</data>
</return>
</pgm>
</script>

adc@cairns:~/src/zmaster/zmaster_tool/tests$ php xxbigboy.php 100000
<h1>Calling Big Boy PGM</h1>
<h1>100000 Records Input/Ouput</h1>
<p>Welcome aboard xmlservice toolkit hacker crew, flying 100000 records round trip.</p>
<p>Your flight time today: Time (loop=1) total=12.63 sec (0.08 calls/sec) (12.626663 sec per call)
</p>
</p>
1:B99980:99980.1:B99981:99981.1:B99982:99982.1:B99983:99983.1:B99984:99984.1:B99985:99985.1:B99986:99986.1:B99987:99987.1:B99988:99988.1:B99989:99989.1:B99990:99990.1:B99991:99991.1:B99992:99992.1:B99993:99993.1:B99994:99994.1:B99995:99995.1:B99996:99996.1:B99997:99997.1:B99998:99998.1:B99999:99999.1:B100000:100000.1:</records>
</parm>
<return>
<data type='10i0'>0</data>
</return>
</pgm>
</script>
rangercairns
 
Posts: 216
Joined: Fri Jul 24, 2009 6:28 pm

Re: High speed "gigantic data" XMLSERVICE run it here ...

Postby rangercairns on Wed Nov 21, 2012 3:13 pm

Outstanding best of geek funny (my view), we put up a demo of new big data record XMLSERVICE ... and of course as is true public demos everywhere ... Yips machine ISP provider has been having issues, so sorry if you can not reach Yips machine today. I looked and machine isn't doing anything at all, but ISP connection can be slow (including telnet green screen).
Code: Select all
                             Work with Active Jobs                     KALYPSO
                                                             11/21/12  07:03:51
CPU %:     2.0     Elapsed time:   00:00:00     Active jobs:   299
rangercairns
 
Posts: 216
Joined: Fri Jul 24, 2009 6:28 pm

Re: High speed "gigantic data" XMLSERVICE run it here ...

Postby rangercairns on Tue Nov 27, 2012 3:13 pm

More business like "complex data" structures ... 2000 products in/out with prices and simulated errors, etc. ... data is bogus ... but all there ... 1 second speed.

run it -> http://www.youngiprofessionals.com/wiki ... ztable.php
view it -> http://www.youngiprofessionals.com/wiki ... le.src.php

FYI -- Running $ctl.='*test' mode acts same as if called RPG/Cobol push/pop of all data in/out memory ... just skips call.
rangercairns
 
Posts: 216
Joined: Fri Jul 24, 2009 6:28 pm

Re: High speed "gigantic data" XMLSERVICE run it here ...

Postby rangercairns on Tue Nov 27, 2012 6:52 pm

I forgot to mention "gigantic data" enhancement is available for download in testing section of XMLSERVICE wiki page.

http://www.youngiprofessionals.com/wiki ... ICETesting
-> 2012–11–26 -xmlservice-rpg-1.7.5-sg2.zip
rangercairns
 
Posts: 216
Joined: Fri Jul 24, 2009 6:28 pm


Return to New Toolkit

Who is online

Users browsing this forum: Exabot [Bot] and 1 guest