Need a special offer?Find out if your project fits.
+

How much data the product can load?

Answered
Donggeon Kim asked on January 7, 2020

How much data the product can load?
In an explorer environment, we want to load data with 300,000 rows and 30 columns.(JSON file)
However, when loading data, it uses more than 1gb of memory and Explorer does not work.
I think the one million rows demo has a million rows, but it's like three columns of data.
(How many columns is the one million row demo data?)
How many column data can load 300,000 rows in Explorer environment?

1 answer

Public
Illia Yatsyshyn Illia Yatsyshyn Flexmonster January 8, 2020

Hello,
 
Thank you for reaching out to us.
 
Being a client-side component, Flexmonster relies on resources available to the browser, and this affects the loading time and the maximum size of the data that can be handled on every particular machine.
This means that the client computer's RAM determines how much data can be loaded at once, and CPU capabilities affect how much time is spent on the data analyzation.
 
In case the required data set appears to be too big for the specific machine and the browser of the user, our team kindly recommends considering using MS Analysis Server or Elasticsearch as a data source.
 
We would like to provide some explanations regarding the difference between MS Analysis Server & Elasticsearch and other data sources (e.g., CSV, JSON).
 
The key point is when the browser loads data:

  • If the CSV data set is used, all data has to be loaded before the component starts displaying any report.
  • In the case of using MS Analysis Server or Elasticsearch, Flexmonster can handle much larger data because not all data is loaded into the browser at once. Only the part of the data needed for the current representation in Flexmonster is sent to the client-side when using MS Analysis Server or Elasticsearch. Every time more data needs to be shown, a query is formed, and a different set of data is sent to Flexmonster. This way, memory is used in moderation.

 
More information about performance can be found within the following threads:

 
You are welcome to contact us in case additional questions occur.
 
Regards,
Illia

Please login or Register to Submit Answer