+ 3

Challenge question

- If you had 30 Million x and y values, how would you plot them? - Python only

26th Jun 2018, 3:55 AM
Anthony Perez
9 Réponses
+ 2
Drawing huge data on small chart, you could round the numbers to nearest pixel before plot it. R language are good at plotting big data chart.
26th Jun 2018, 6:23 AM
Calviղ
Calviղ - avatar
+ 4
no i mean read from file or what?
26th Jun 2018, 4:45 AM
Abdur-Rahmaan Janhangeer
Abdur-Rahmaan Janhangeer - avatar
+ 3
30 million x and y stored in what format?
26th Jun 2018, 4:03 AM
Abdur-Rahmaan Janhangeer
Abdur-Rahmaan Janhangeer - avatar
+ 3
[Initial thought before sleep] I'd spray the data at the graphics hardware as close to directly / in parallel as possible, using some lower-level import. This is what Python's good at anyway (delegating as a 4GL, not trying to be a 3GL). Reasoning: I used to add assembly direct-to-display-buffer plotting to my graphics codes because standard libraries were too slow. Now we can leverage the GPU data bus; Python would send a data blob, and then inform the GPU of its structure. Lest this discourage anyone (because you can't get to that hardware here), you could still emulate the idea on a smaller scale with a square array/buffer you call 'the output'. Also:Numpy works here, and it's good with rectangular matrices, the shape video buffers come in too.
26th Jun 2018, 6:20 AM
Kirk Schafer
Kirk Schafer - avatar
+ 2
Calviղ it said python ^^
26th Jun 2018, 6:24 AM
Abdur-Rahmaan Janhangeer
Abdur-Rahmaan Janhangeer - avatar
+ 1
Graphing algorithm Abdur-Rahmaan Janhangeer
26th Jun 2018, 4:18 AM
Anthony Perez
+ 1
Store them as arrays. And it is sorta impossible to plot 30 million points unless you have a super computer
26th Jun 2018, 4:20 AM
Andre Daniel
Andre Daniel - avatar
26th Jun 2018, 5:01 AM
Anthony Perez
+ 1
Are they integers, or real numbers? What is the organization of the points? Are they sorted in either axis? Do they have multiple Y values per X (or vice-versa)? Do they describe an image, or is the expected result a graph? If a graph, what kind? Consider sampling the data down to the display resolution. If there are multiples of the same X and Y points, then you might take a scientific visualization approach and show color or brightness differences as a point is re-used more frequently.
27th Jun 2018, 12:43 AM
Brian
Brian - avatar