Reading big XML Files

After a quick search I stumbled upon this

Nonetheless, I have a similar issue nowadays by parsing a quite big XML file (XMLRead Reactive) or with HTTPGet (which was my initial goal) are failing to process the Reading phase.

In Progress indicator will remain ni a TRUE state no matter how much time I ll be waiting for.

How to deal with such kind of sized files (XML) ?

the xml file is approx 8mb

image

Do you have some example file?

I tried with a bunch of files from here and even the one with ~ 700 MB loaded fairly quickly on my potato laptop (albeit consuming a lot of memory).

1 Like

yeah, that’s correct, seems that there is probably a similar issue to the forum thread I added in my initial post.

Maybe XPath processes blocking the whole thing, it works fairly well with smaller files.

this is my source anyways:
https://data.raspberryshake.org/fdsnws/station/1/query

Yes I think it is the XPath. Doing something like this for example completely stalled vvvv:

/FDSNStationXML/Network/Station/@code | 
/FDSNStationXML/Network/Station/@startDate | 
/FDSNStationXML/Network/Station/@endDate |
 /FDSNStationXML/Network/Station/@restrictedStatus

Parsing it using XElement nodes seems to work fine though.

ParseTest.vl (35.2 KB)

2 Likes