optimization 2 (use iter instead fetchall())

a9dd22c0 · mouadh · e860fadc · a9dd22c0
Commit a9dd22c0 authored Jun 08, 2017 by mouadh
Hide whitespace changes
Inline Side-by-side

Showing with 142 additions and 0 deletions

olapy/core/mdx/tools/bech_mem_opt2.txt olapy/core/mdx/tools/bech_mem_opt2.txt +142 -0

No files found.
--- a/olapy/core/mdx/tools/bech_mem_opt2.txt
+++ b/olapy/core/mdx/tools/bech_mem_opt2.txt
+Memory summary:1 - before executing query //// _load_tables_db
+
+VM: 700.28Mb
+
+Memory summary:2 - after query, before fetchall  /////// _load_tables_db
+
+VM: 2781.79Mb
+
+Memory summary:1 - before executing query //// 1111 _construct_web_star_schema_config_file 
+
+VM: 2782.04Mb
+
+Memory summary:2 - after query, before fetchall  /////// 222222222222 _construct_star_schema_config_file
+
+VM: 2782.29Mb
+
+Memory summary:1 - before executing query //// 3333333333 _construct_web_star_schema_config_file 
+
+VM: 2782.29Mb
+
+Memory summary:2 - after query, before fetchall  /////// 44444444 _construct_star_schema_config_file
+
+VM: 2784.29Mb
+
+Memory summary:1 - before executing query //// 55555555 _construct_web_star_schema_config_file 
+
+VM: 2784.29Mb
+
+Memory summary:2 - after query, before fetchall  /////// 6666666666 _construct_star_schema_config_file
+
+VM: 2784.29Mb
+
+Memory summary:1 - before executing query //// 1111 _construct_web_star_schema_config_file 
+
+VM: 2784.04Mb
+
+Memory summary:2 - after query, before fetchall  /////// 222222222222 _construct_star_schema_config_file
+
+VM: 2783.79Mb
+
+Memory summary:1 - before executing query //// 3333333333 _construct_web_star_schema_config_file 
+
+VM: 2783.79Mb
+
+Memory summary:2 - after query, before fetchall  /////// 44444444 _construct_star_schema_config_file
+
+VM: 2784.29Mb
+
+Memory summary:1 - before executing query //// 55555555 _construct_web_star_schema_config_file 
+
+VM: 2784.29Mb
+
+Memory summary:2 - after query, before fetchall  /////// 6666666666 _construct_star_schema_config_file
+
+VM: 2784.29Mb
+
+
+Memory summary:1 - before executing query //// _load_tables_db
+  types |   # objects |   total size
+======= | =========== | ============
+   dict |        7429 |      8.72 MB
+    str |       58990 |      8.30 MB
+----------------------------
+Memory summary:2 - after query, before fetchall  /////// _load_tables_db
+                                types |   # objects |   total size
+===================================== | =========== | ============
+  <class 'pandas.core.frame.DataFrame |         180 |      2.01 GB
+                                 dict |        7802 |      8.88 MB
+----------------------------
+Memory summary:1 - before executing query //// 1111 _construct_web_star_schema_config_file 
+                                types |   # objects |   total size
+===================================== | =========== | ============
+    <class 'pandas.core.series.Series |         592 |      2.01 GB
+  <class 'pandas.core.frame.DataFrame |         179 |      2.01 GB
+----------------------------
+Memory summary:2 - after query, before fetchall  /////// 222222222222 _construct_star_schema_config_file
+                                types |   # objects |   total size
+===================================== | =========== | ============
+    <class 'pandas.core.series.Series |         618 |      2.01 GB
+  <class 'pandas.core.frame.DataFrame |         180 |      2.01 GB
+----------------------------
+Memory summary:1 - before executing query //// 3333333333 _construct_web_star_schema_config_file 
+                                types |   # objects |   total size
+===================================== | =========== | ============
+    <class 'pandas.core.series.Series |         618 |      2.01 GB
+  <class 'pandas.core.frame.DataFrame |         180 |      2.01 GB
+----------------------------
+Memory summary:2 - after query, before fetchall  /////// 44444444 _construct_star_schema_config_file
+                                types |   # objects |   total size
+===================================== | =========== | ============
+  <class 'pandas.core.frame.DataFrame |         185 |      2.01 GB
+    <class 'pandas.core.series.Series |         618 |      2.01 GB
+----------------------------
+Memory summary:1 - before executing query //// 55555555 _construct_web_star_schema_config_file 
+                                types |   # objects |   total size
+===================================== | =========== | ============
+    <class 'pandas.core.series.Series |         630 |      2.01 GB
+  <class 'pandas.core.frame.DataFrame |         185 |      2.01 GB
+----------------------------
+Memory summary:2 - after query, before fetchall  /////// 6666666666 _construct_star_schema_config_file
+                                types |   # objects |   total size
+===================================== | =========== | ============
+  <class 'pandas.core.frame.DataFrame |         185 |      2.01 GB
+    <class 'pandas.core.series.Series |         604 |      2.01 GB
+----------------------------
+Memory summary:1 - before executing query //// 1111 _construct_web_star_schema_config_file 
+                                types |   # objects |   total size
+===================================== | =========== | ============
+  <class 'pandas.core.frame.DataFrame |         180 |      2.01 GB
+    <class 'pandas.core.series.Series |         592 |      2.01 GB
+----------------------------
+Memory summary:2 - after query, before fetchall  /////// 222222222222 _construct_star_schema_config_file
+                                types |   # objects |   total size
+===================================== | =========== | ============
+    <class 'pandas.core.series.Series |         629 |      2.01 GB
+  <class 'pandas.core.frame.DataFrame |         181 |      2.01 GB
+----------------------------
+Memory summary:1 - before executing query //// 3333333333 _construct_web_star_schema_config_file 
+                                types |   # objects |   total size
+===================================== | =========== | ============
+    <class 'pandas.core.series.Series |         629 |      2.01 GB
+  <class 'pandas.core.frame.DataFrame |         181 |      2.01 GB
+----------------------------
+Memory summary:2 - after query, before fetchall  /////// 44444444 _construct_star_schema_config_file
+                                types |   # objects |   total size
+===================================== | =========== | ============
+  <class 'pandas.core.frame.DataFrame |         186 |      2.01 GB
+    <class 'pandas.core.series.Series |         629 |      2.01 GB
+----------------------------
+Memory summary:1 - before executing query //// 55555555 _construct_web_star_schema_config_file 
+                                types |   # objects |   total size
+===================================== | =========== | ============
+    <class 'pandas.core.series.Series |         641 |      2.01 GB
+  <class 'pandas.core.frame.DataFrame |         186 |      2.01 GB
+----------------------------
+Memory summary:2 - after query, before fetchall  /////// 6666666666 _construct_star_schema_config_file
+                                types |   # objects |   total size
+===================================== | =========== | ============
+  <class 'pandas.core.frame.DataFrame |         186 |      2.01 GB
+    <class 'pandas.core.series.Series |         615 |      2.01 GB
+
+