asked on September 30, 2020
Hello,
I am sure this is probably something that needs to be handled outside of Flex but I thought I would throw it over to you for your input.
We have our data in a relational database (designed in Claris) which we use to currently produce JSON. The issue we have is that these JSON packets are growing far too heavy. Is it possible for Flex to translate and join this JSON?
For example:
{"Name":"Scott","Colour":"Red","Car_ID":"123456789"},
{"Name":"Tom","Colour":"Blue","Car_ID":"123456789"},
{"Car_ID":"123456789","Manufacturer":"Mazda","Model":"MX5"}
⋅ October 2, 2020
Hi Scott,
Thank you for posting your question.
As of now, Flexmonster does not provide built-in functionality for modifying the JSON data that is being loaded to the pivot table. We would suggest implementing your own custom data pre-processor in case it needs to be reformatted before being received by Flexmonster.
We would like to mention the Flexmonster supports another JSON format, where the data is structured as an array of arrays & each sub-array contains ordered values – this results in a CSV-like look & helps with data set size optimization. Please find an example of the array of arrays approach below:
[
[
"Category",
"Color",
"Price",
"Quantity"
],
["Ice-cream", "red", 23.32, 4],
["Ice-cream", "yellow", 4.2, 3],
["Sweets", "red", 45.3, 2],
["Candies", "orange", 22.65, 7]
]
Alternatively, we would also suggest considering the Flexmonster Data Server for your project, which is an implementation of our custom data source API, highly optimized for particular databases, CSV & JSON. At the core of the custom data source API lies the idea of assigning the heavy lifting of fetching, processing, and aggregating the data to the server, after which only the necessary parts of the data are transferred to the client-side.
Feel free to find more info on this by the links above.
Please let us know if this helps.
Regards,
Mykhailo
⋅ October 14, 2020
Hi Scott,
How are you?
Just checking in to ask whether you've had a chance to review our previous response with suggestions on data loading – have you found it helpful?
We would be grateful for your feedback.
Best regards,
Mykhailo
⋅ October 15, 2020
Hey Mikey,
I appreciate the checkin. Unfortunately, no it hasn't really helped. Mainly what we are looking to do is to increase speed and reduce the size of our dataset that we feed flex.
One report in particular has creeped past the 25MB mark, so any optimisation or speed that we can gain would be ideal.
We certainly aim to review the flex data server, but that is probably a job for the Christmas holidays.
Have you got any strong recommendations on where we prioritise our time to increase speed and reduce size?
⋅ October 16, 2020
Hi Scott,
In this case, it seems like the Flexmonster Data Server really is the best option we can offer.
Alternatively, as a general idea, we could suggest using gzip compression to compress the JSON-data response on the server-side, thereby decreasing the size of the dataset transferred through the network.
Please let us know if this helps.
Regards,
Mykhailo
⋅ January 13, 2021
Hi Scott,
Hope you're doing great!
We were wondering if you've had a chance to review the Flexmonster Data server for your needs. Please let us know in case there are any questions we can help you with.
Kind regards,
Mykhailo