If you need to perform an initial file ingest into your new NetX instance during Onboarding, or have a large number of assets to import into an existing instance, NetX provides two methods for file import (aside from Uploading Assets through the browser interface):

  1. Use the NetX I/O app: Both SaaS and on-premise customers can install this desktop application in your local environment. Convenient for larger ingests, NetX I/O is used to map folders of files on a local drive to folders within NetX. See our documentation for more information about NetX I/O.
  2. Ship us a drive: If you're a SaaS customer, you may ship us a USB storage device containing your files (accompanied by a manifest) and we'll upload directly into your application repository. Please be aware of the guidelines below when using this service.

If any of the following requirements are not met, NetX may charge consulting hours at our standard rate for any extra work required.
This includes, but is not limited to: reorganizing, uncompressing, decrypting, renaming, or other scrubbing of data.

Before you begin

Please read our guidelines on Hard Drive Requirements for hardware, formatting, security and shipping information before copying files to the hard drive.

Folder structure

  • Create your desired folder structure on the hard drive under a single top-level folder entitled "NetX".
  • IMPORTANT! The folder structure immediately under the "NetX" folder on the hard drive must map 1-to-1 to the top-level folder structure in the NetX application.
  • Any subfolders on the drive that do not map 1-to-1 will be automatically created in NetX. Please pay attention to spelling and spacing to avoid the creation of unnecessary subfolders.
  • Empty folders can be included if you want any folders to be automatically created within NetX.
  • Remove illegal characters from your folder names. If illegal characters are detected, they will be replaced by underscores during the ingestion (or in some cases, the folder may be rejected). See Illegal Characters in Asset and Folder Names for details.

File naming

  • Do not include filenames with invalid extensions or with no extensions. See Supported File Formats for more info.
  • Do not include hidden files or folders.
  • Make sure to standardize case on your files, especially on file extensions: file.jpg and file.JPG will be treated as two different files in search, etc.
  • Be aware of illegal characters in file names. If illegal characters are detected, they will be replaced by underscores during the ingestion (or in some cases, the folder may be rejected). See Illegal Characters in Asset and Folder Names for details.

How to generate an asset manifest

A manifest of files on your hard drive is required to help NetX engineers properly assess your collection and assist in validating when the ingestion completes.  There are native tools built into modern operating systems which simplify generating a manifest.

The following instructions assume you have a USB Hard Drive attached to your workstation, mounted as a volume entitled "External Drive" (Mac OS X) or mounted as the "D:\" drive (Windows).
If your drive is mounted to a different location, make the necessary adjustments in the following example command lines.

Mac OS X

  1. Copy your files onto the USB Hard Drive you intend to send to NetX
  2. Open Terminal.app (Applications → Utilities → Terminal.app)
  3. Run the following command (replacing "/Volumes/External Drive" with the path to your external drive)
  4. Move the file netx-asset-manifest.txt from your Desktop to the USB Hard Drive
find "/Volumes/External Drive" -type f > ~/Desktop/netx-asset-manifest.txt
CODE

Windows

  1. Copy your files onto the USB Hard Drive you intend to send to NetX
  2. Open Powershell.exe (C:\system32\WindowsPowerShell\v1.0\powershell.exe)
  3. Run the following command (replacing D:\ with the volume where your drive is mounted)
  4. Move the file netx-asset-manifest.csv from your Desktop to the USB Hard Drive
Get-ChildItem -Recurse D:\ -File | Select-Object Directory,Name |Export-Csv -Path $Env:HOMEPATH\Desktop\netx-asset-manifest.csv -Encoding ascii -NoTypeInformation
CODE

Common questions

How long will the ingest take?

It is difficult to estimate exactly how long an ingest will take. Every format has its own variables and it can take from hours to days to weeks to ingest everything, depending on the collection. Complex files like PDFs, videos and multi-page documents take longer to process than images. The number of files is more of a consideration than the size of files. Lots of tiny PDF files with vector graphics can take much longer to process than a collection of large TIF images. Full document indexing will also impact upload time. 

Can assets be moved or renamed as soon as they are visible in NetX?

No, please avoid moving or renaming any files while an ingest is in progress. You will be notified when the ingest process has completed for the entire drive and then regular tasks may resume.

Can de-duplication take place at the same time as the ingest?

No, it's best to de-duplicate after the ingest has finished to simplify the import verification process.