Questions and answers

Concrete problems with XML and JSON files, and how to solve them in Nodeflip. Everything runs in your browser, and your files are not uploaded.

Finding the files that cause a problem

How do I find which XML or JSON files in a large batch are missing a field?

Load the files, or a ZIP with all of them, into Nodeflip and run Data Analysis. Every field gets a list of its values, and when a field is missing, null or empty in some files, the list starts with an entry called (Null/Empty). Click it and the analysis is filtered to exactly those files, which are listed under Source Files.

The entry covers all three cases: "deliveryDate": null, "deliveryDate": "" and a file where the field is not there at all. A text search cannot find the last case, because there is nothing to search for.

Read more: Find files with missing values · Data Analysis documentation

How do I find the files that contain a specific value among thousands of XML or JSON files?

In Nodeflip's Data Analysis, every field lists the values it has across all loaded files, with the number of files for each. Click a value and the analysis is filtered to the files that have it. The other fields then show only what occurs in those files, which often points to the cause: the same sender, the same order type or the same hour.

Read more: Data Analysis

How do I filter files on a list of IDs, for example forty order numbers from a support ticket?

Right-click the field in Nodeflip's Data Analysis and choose Filter multiple values, then paste the list. The values can be separated by new lines, commas, semicolons or tabs. You can also drag across values to select a range, or hold Ctrl (Cmd on Mac) and click values that are not next to each other.

Read more: Data Analysis documentation

How do I see all the values a field has across many files, and how often each occurs?

Run Data Analysis in Nodeflip. It lists every field of every structure in the files with its distinct values and their counts, and shows how many values are null or empty, without any query or script. For "give me this value from each file" rather than "which values exist", use the Data Extractor instead.

Read more: Data Analysis

Can I analyze the files in a ZIP archive without unpacking it?

Yes. Nodeflip reads XML and JSON files straight from a ZIP and analyzes all the files in it. Without registering you can work with ZIP archives of up to 25 files. Larger archives require a free registration.

Read more: File management

Structure, schema drift and API changes

How do I detect that an API response format has changed?

Collect a few hundred responses from each version and load them into Nodeflip's Data Analysis. Files with different structures are grouped apart, and selecting two structures opens Schema Drift Analysis. It lists every field with how often it occurs in each structure, so removed fields and fields that went from always present to only sometimes present stand out. A diff of two sample files misses the second kind.

Read more: Detect breaking API changes · Schema drift documentation

How do I compare the structure of many JSON or XML files when there is no schema?

Nodeflip derives the structures from the files themselves. Data Analysis groups the files by structure, shows how similar the groups are in percent, and marks fields that are missing or only present in some of the files. No XSD or JSON Schema is needed, and XML and JSON files can be analyzed in the same run.

Read more: Compare XML and JSON structure

How do I find fields that are only present in some of the files?

In Nodeflip's Data Analysis, every field shows the share of files it occurs in. In the Schema Drift panel, fields in all files are green, fields in some files orange and missing fields red, and Show Incomplete Only hides everything that is present everywhere.

Read more: Schema drift documentation

How do I compare two XML or JSON files side by side?

Open the first file in Nodeflip's Source view, click Compare To… and choose the second file. A side-by-side diff opens, built on the same Monaco editor as Visual Studio Code, with additions and deletions marked and the panes scrolling together. To compare only the structure, use Hide Values in the Tools menu first.

Read more: Compare JSON files · Compare Files

Extracting values with XPath

How do I extract one value from every XML file in a folder or a ZIP?

Use Nodeflip's Data Extractor. It runs one XPath expression over every file you select, including the files inside ZIP archives, and lists the result per file. When an expression matches several nodes in a file, each match gets a row of its own. The result can be copied or downloaded as CSV.

Read more: XPath patterns for many files · Data Extractor documentation

How do I get the XPath of an element without writing it by hand?

Open the file in Nodeflip's Tree view and click the element. The XPath bar shows its path, and the copy button puts it on the clipboard. Remove a position such as [2] from the path to match all elements of that name instead of the second one.

Read more: Tree View

Why does my XPath not match when the XML file has a namespace?

In strict XPath, /order does not match an element in a default namespace such as <order xmlns="urn:example:orders">. Nodeflip's Data Extractor handles namespaces for you, including default namespaces, so the plain path usually works. When it does not, //*[local-name()='order'] matches regardless of namespace.

Read more: Data Extractor documentation

How do I get two values from each XML file on the same row?

Join the expressions with & in Nodeflip's Data Extractor, for example /order/@id & ';' & /order/customer/country, which gives values such as ORD-0001;SE, one per file.

Read more: XPath patterns for many files

Can I convert XML to CSV or Excel?

Nodeflip does not convert a whole XML file to a table. To get chosen values out of one or many files, run an XPath expression in the Data Extractor and download the result as CSV, which opens in Excel. A list inside a single file can also be read as a sortable, filterable grid in the file viewer.

Read more: Data Extractor

Large files

How do I open an XML or JSON file that is too large for my editor?

Open it in Nodeflip. The file is parsed once, and lists and tables with more than 100 items are paged 100 at a time, so a file with a very large array stays usable. Filter a table on a column instead of paging through it, and use Get Filtered Data in the Tools menu to take out the matching part as a file of its own.

Read more: Large XML file viewer · Open large files in the browser

How large a file can Nodeflip handle?

It depends on the memory of your computer, since everything runs in the browser. In our own tests, files of tens of megabytes open well in the Tree view, a 200 MB XML file with close to 117,000 records was analyzed and filtered in Data Analysis when loaded as a ZIP, and a 500 MB file was too much for the browser. Load large files as a ZIP: XML compresses well, and a 200 MB file can be under 10 MB zipped.

Read more: Large XML file viewer

How do I split a large XML file into separate records?

Run Data Analysis in Nodeflip and click the split icon next to the list you want, for example Analyze per Transaction. Each item becomes a record that can be filtered by clicking values, and the records that are left can be exported as separate XML files or as a ZIP. Each exported record is a well-formed document with its namespaces declared. Nodeflip writes one record per file and does not cut a file into pieces of a fixed size.

Read more: Split a large XML file

How do I filter and sum the records inside one large file?

Use Analyze per in Nodeflip's Data Analysis to turn a list, such as the transactions of a ledger, into records. Filter them by clicking values, add a field to the Data Grid and choose Sum, and the sum follows the filters. It works for any array of objects in JSON as well.

Read more: One large file, many records

XSLT and conversion

How do I run an XSLT 2.0 or 3.0 stylesheet without installing Saxon or Java?

Use Nodeflip's Data Transform. It runs XSLT 1.0, 2.0 and 3.0 with SaxonJS in your browser, so instructions such as xsl:for-each-group and XPath 3.1 functions work, and there is nothing to install. The XSLT tester shows which lines of the stylesheet produce which output.

Read more: XSLT tester online · Data Transform

How do I apply one XSLT stylesheet to many XML files at once?

Select several XML files or a ZIP archive in Nodeflip's Data Transform and run the stylesheet. Every file is transformed, and you get a ZIP back with the same file names and folders. The output method of the stylesheet decides whether the result is XML, text, HTML or JSON.

Read more: Run XSLT in the browser

Can an XSLT stylesheet in Nodeflip load other documents?

No. For privacy, a stylesheet run in Nodeflip cannot read other files or URLs, and a stylesheet that calls document() on another file will not find it. A stylesheet that depends on other files needs to be made self-contained first.

Read more: Data Transform documentation

How do I convert XML to JSON, or JSON to XML?

Open the file in Nodeflip's Source view and choose Convert Format in the Tools menu. The result can be downloaded beautified or minified. For a conversion with rules of your own, write an XSLT stylesheet and run it in Data Transform.

Read more: File viewing documentation

Generating test data

How do I generate many test XML or JSON files from one sample file?

Load the sample into Nodeflip, open Test Data and click Suggest Rules. Nodeflip proposes a rule for each field it recognises, such as new UUIDs, running order numbers, today's dates and references that follow another field, and you review each suggestion before it is applied. Choose the number of files and generate them as a ZIP or into the file list.

Read more: Test Data Generator · Test Data documentation

How do I make totals and counts in generated test files match the lines?

Give the total the Calculate behavior in Nodeflip's Test Data Generator. It works a field out from the generated values: a sum, count, average, lowest or highest over a list, or a product, sum, difference or percentage of the fields beside it. An order total sums the lines of its own order, VAT can be 25 % of the total, and calculations can build on each other.

Read more: Test data that adds up

How do I give each generated order a different number of lines?

Click the item count on the list in Nodeflip's Test Data Generator and choose a random number between two values, such as 1 and 6. The count is drawn anew for each list, so every order gets its own number of lines. A fixed number and a multiple of the template's count are also available, and an XML element that occurs once can be made a list with Repeat.

Read more: Number of items

How large test files can Nodeflip generate?

Nodeflip estimates the size before you generate and refuses a run that would give files over about 200 MB each, or 500 MB in all, instead of attempting it.

Read more: Test Data documentation

Formats and validation

Can I open e-invoices, bank files and SAF-T audit files?

Yes. Nodeflip opens any well-formed XML, so Peppol BIS and UBL invoices, XRechnung, ZUGFeRD and Factur-X XML, ISO 20022 bank messages such as camt.053 and pain.001, and SAF-T files of any country open without a schema. Each format has a page that describes its structure.

Read more: Tools by format

Does Nodeflip validate XML against an XSD or JSON against a JSON Schema?

No. Nodeflip checks that a file can be read as XML or JSON when it is loaded, and it shows and analyzes the content, but it does not validate against an XSD, a JSON Schema, Schematron or the rules of a format such as EN 16931. Use a validator for that, and Nodeflip to find out what the files actually contain.

When is Nodeflip not the right tool?

For files of several gigabytes, use a streaming parser or a streaming XSLT processor, since Nodeflip runs in the browser and is limited by its memory. For schema validation, use a validator. For a conversion that runs every night, a script or an integration platform is the better home, although Nodeflip is a quick way to write and test the stylesheet first.

Privacy, price and setup

Are my files uploaded when I use Nodeflip?

No. Nodeflip reads, parses and analyzes your files with code that runs in your own browser, and the files are not uploaded to a server. The app sends anonymous usage statistics (file type and file size, never file names or content) and error reports.

Read more: Local processing

Can I analyze production files with customer data in Nodeflip?

Nodeflip is built for it: since the files stay in your browser, there is no copy of them on a server to secure, delete or explain to a customer. That makes it usable when you are not allowed to upload customer data to an online tool or paste it into an AI service. Check your own organisation's rules for the browser and the device you use.

Read more: Local processing

Is Nodeflip free?

Yes, Nodeflip is free to use. Without registering you can have two files loaded at a time and work with ZIP archives of up to 25 files. Beyond that you need to register, which is also free.

Do I need to install anything?

No. Nodeflip runs in a modern browser at app.nodeflip.com. An optional Chrome extension opens XML and JSON files you download directly in Nodeflip.

Read more: Browser extension

Have a question that is not here?

Write to support@nodeflip.com, or open Nodeflip and try it on your own files.

Open Nodeflip