1. Ian Mayo Avatar Ian Mayo
  2. Untitled project
  3. gnd

Wiki

Clone wiki

gnd / Tests to Import data

View History

Bulk Save & RDBNS

Here are three sets of test results. They cover Couchdb-normal save, CouchDb-bulk save, and PostGresql-normal save.

Test parameters:
 Strategy   : Generate tracks in first loop and save them in second loop
 Url        : http://127.0.0.1:5984
 Backend    : null
 Database   : tracks
 Track type : 2d
 Tracks num : 2000
 Points num : 500
 Validation : true
 Bulk-Save  : true
---------------------------
EktorpDao.connect takes: 806
---------------------------
Generation takes: 734
Operation takes: 126616
Time per track: 63
Time per point: 0.127

GenerateFirstStrategy.doTest takes: 127352
---------------------------
EktorpDao.close takes: 1
---------------------------
Overall test takes: 128159
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%

Test parameters:
 Strategy   : Generate tracks in first loop and save them in second loop
 Url        : http://127.0.0.1:5984
 Backend    : null
 Database   : tracks
 Track type : 2d
 Tracks num : 2000
 Points num : 500
 Validation : true
 Bulk-Save  : false
---------------------------
EktorpDao.connect takes: 807
---------------------------
Generation takes: 729
Operation takes: 140593
Time per track: 70
Time per point: 0.141

GenerateFirstStrategy.doTest takes: 141324
---------------------------
EktorpDao.close takes: 1
---------------------------
Overall test takes: 142133
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
Test parameters:
 Strategy   : Generate tracks in first loop and save them in second loop
 Url        : jdbc:postgresql://localhost:5432/ian_tracks
 Backend    : postgres
 Database   : tracks
 Track type : 2d
 Tracks num : 2000
 Points num : 500
 Validation : true
 Bulk-Save  : false
---------------------------
PostGISDao.connect takes: 202
---------------------------
Generation takes: 787
Operation takes: 380364
Time per track: 190
Time per point: 0.38

GenerateFirstStrategy.doTest takes: 381153
---------------------------
PostGISDao.close takes: 1
---------------------------
Overall test takes: 381356

Previous results

The goal of the test is to find out time spent in saving a Track with sufficiently large points. The Tracks are represented by a modified version of GeoJSON LineString.

Track Format:

{  
   "@type": "d", 
   "@class": "Tracks", 
   "type": "LineString",
   "coordinates": [0.6090679566546295,51.47038625423184,490.67301729370524,51.47038625423345]
}

The co-ordinates are generated randomly for each track and doesn't represent actual latitude or longitude. The following table shows how the time varies with the number of points

Results:

                            Avg Time Taken to Store Tracks in OrientDB (in ms)
Number of Points                  Local DB                         Remote DB  
                          Native API     REST API          Native API     REST API             
    10000                  6463                             8543
    20000                  30479                            33172
    30000                  66249                            80481

Machine Used:

Mac OS X Version 10.6.8
Processor 2.4 GHz Intel Core 2 Duo
Memory 4 GB 1067 MHz DDR3

Updated