LucidLink Connect Overview

  • Updated

LucidLink Connect makes external files accessible via S3-compatible API or HTTP URLs available for direct, on-demand streaming through the filespace without copying any data. Admins link external files into the filespace, and everyone with access can then open them like any other file on any supported LucidLink platform.

LucidLink Connect is currently available as a paid add-on for Enterprise plans. Contact your account team to add it. It works on filespace format 3.6 or newer (format 3.8 or newer for HTTP files).

What is LucidLink Connect?

LucidLink Connect expands the horizons of LucidLink's file streaming technology by allowing in-place streaming of pre-existing data from external sources. Files from other platforms linked via LucidLink Connect are instantly visible and available for streaming via the filespace without copying them. When someone opens an external file, the app streams only the parts it reads directly from your storage.

  • A data store is a saved connection to an S3-compatible bucket or HTTP-based data source.
  • An external file is a file in the filespace that points at one object in that bucket, or at one HTTP link.

External files sit in the same folders as your other files, are subject to the same filespace permissions, and open in the desktop, web and mobile apps.

The diagram shows an S3-compatible bucket and an HTTP link in your storage connecting to two data stores in the production filespace, with no file content copied. Three external files sit in a folder next to a native file. The desktop, web and mobile apps open them like any file, and file bytes stream directly from your storage to the app.
The diagram shows an S3-compatible bucket and an HTTP link in your storage connecting to two data stores in the production filespace, with no file content copied. Three external files sit in a folder next to a native file. The desktop, web and mobile apps open them like any file, and file bytes stream directly from your storage to the app.

Using LucidLink Connect in the web and desktop

The web and desktop apps, covered below, are one way to use LucidLink Connect. The LucidLink API, Python SDK and CLI are another: see the LucidLink Connect overview for the API, LucidLink Connect in the Python SDK and the CLI overview on the Developer Portal.

Step-by-step Guide

Prerequisites

  • A workspace Owner or Admin, or a Filespace admin of the filespace.
  • A filespace with format 3.6 or newer for S3-compatible storage or 3.8 or newer for HTTP data stores (this is shown as Filespace format under Filespace details: in the web app, select Filespace details in the filespace menu; in the desktop app, open the filespace dashboard).
  • An access key and secret key with s3:GetObject on the objects in the bucket, plus s3:ListBucket on the bucket to browse it in the app. LucidLink Connect needs no write or delete permission; use read-only keys scoped to the bucket.
  • A bucket endpoint or link starting with https://. Plain http:// does not work in either app.

The web app reads your bucket directly from the browser, so the bucket's CORS policy (a bucket setting that lists which websites can read it) must allow https://app.lucidlink.com and expose the ETag and Content-Range headers. The desktop app does not need it. An example policy in Amazon S3 format:

[
  {
    "AllowedHeaders": ["*"],
    "AllowedMethods": ["GET", "HEAD"],
    "AllowedOrigins": ["https://app.lucidlink.com"],
    "ExposeHeaders": ["ETag", "Content-Range", "Content-Length"]
  }
]

For provider-specific steps, see Configuring CORS for Custom Storage Buckets.

Open LucidLink Connect

In either app, expand the filespace in the sidebar and select LucidLink Connect (only visible to admins on filespaces where LucidLink Connect is available). The screenshot shows the web app; the desktop app's filespace menu lists LucidLink Connect among different items.

The web app sidebar shows the production filespace expanded. Its menu lists Open in desktop app, Browse files, Snapshots, Access and permissions, Guest links, LucidLink Connect, Filespace settings and Filespace details.
The web app sidebar shows the production filespace expanded. Its menu lists Open in desktop app, Browse files, Snapshots, Access and permissions, Guest links, LucidLink Connect, Filespace settings and Filespace details.

Until you add a data store, the page shows Connect your external files and an Add data store button.

The LucidLink Connect page, before any data store exists, shows the heading Connect your external files and an Add data store button.
The LucidLink Connect page, before any data store exists, shows the heading Connect your external files and an Add data store button.

Add a data store

Click Add data store. In the Create data store dialog, enter a Data store name of 1 to 64 characters: the letters A to Z (no accents), numbers, spaces, hyphens or underscores. The name must be unique in the filespace. You cannot rename a data store later.

S3 data stores

On the S3 tab (on filespace formats below 3.8, the dialog shows these fields without tabs):

  • Provider: Amazon AWS for Amazon S3, or Other for any S3-compatible service. Other adds Endpoint URL, the service endpoint including https://.
  • Bucket name of an existing bucket, and its Cloud storage region (Amazon AWS) or Region name (optional) (Other).
  • Access key and Secret access key. LucidLink stores the secret key encrypted and never shows it again.

Expand Advanced settings for two options:

  • Use virtual-hosted-style addressing is off by default. Turn it on for Amazon S3 buckets, as the app recommends.
  • URL expiration sets how long the access URLs that LucidLink generates for external files stay valid: 7 days (default), or Custom from 4320 to 10080 minutes (3 to 7 days). LucidLink renews them automatically.

Click Create data store. The app opens the bucket, the first test of the connection details: wrong keys or an unreachable endpoint show Can't reach, and a bucket name that does not exist shows "We couldn't load the bucket objects. Please try again later."

The Create data store dialog shows the S3 tab with the data store name, the Amazon AWS provider, bucket name, region, access key and secret access key filled in.
The Create data store dialog shows the S3 tab with the data store name, the Amazon AWS provider, bucket name, region, access key and secret access key filled in.

HTTP data stores

On filespace format 3.8 or newer, the dialog also has an HTTP tab. An HTTP data store holds HTTP links and no credentials: select HTTP, enter a name and click Create data store.

Your data stores

The LucidLink Connect page shows a card for each data store: the bucket name on S3 cards, HTTP on HTTP cards. Each card has a three-dot menu with Connect files and Delete data store, plus View bucket and Manage data store for S3 data stores.

The LucidLink Connect page lists two data stores, an S3 data store that shows its bucket name and an HTTP data store, below the Connect files and Add data store buttons.
The LucidLink Connect page lists two data stores, an S3 data store that shows its bucket name and an HTTP data store, below the Connect files and Add data store buttons.

Browse a bucket and connect files

Click an S3 data store card to open its bucket, then click folders to open them. The app loads a whole folder before it shows it, so large folders take a moment.

Tick the checkbox of each file or folder you want (a folder includes everything beneath it) and click Connect files. Clicking a folder row opens the folder. Opening another folder or using the breadcrumb clears your selection, so connect one folder at a time. The magnifier opens Search this list, which filters the current folder by name; files hidden by a search are not connected.

A bucket opened in LucidLink Connect shows the folders audio and graphics and four files, with hero_v3.mov and teaser_v2.mov selected and the Connect files button in the header.
A bucket opened in LucidLink Connect shows the folders audio and graphics and four files, with hero_v3.mov and teaser_v2.mov selected and the Connect files button in the header.

The Connect files to filespace dialog lists the files. When the selected folders hold more than 1000 objects, it pauses once: Continue lists everything, Cancel closes the dialog without connecting. To rename a file in the filespace, click its pencil (Rename file in filespace), type a name without slashes, and press Enter or click the check mark.

Keep the file extension when you rename a file, so applications still recognize it.

Under Filespace destination, Destination folder starts at Root, the top of the filespace. Click the pencil, type a path, and press Enter or click the check mark; clicking elsewhere discards it. Or click the folder icon (Browse filespace folders) and pick a folder. Missing folders are created.

Keep source prefixes as folder structure is off by default. Off, files keep only the folders below the one you were browsing; on, they keep their full object key path. For example, you browse projects/, select the folder 2026 and set the destination to /incoming:

  • Off: /incoming/2026/spring-campaign/hero_v3.mov
  • On: /incoming/projects/2026/spring-campaign/hero_v3.mov
The Connect files to filespace dialog shows two files from the bucket, the destination folder /incoming/spring-campaign, the unchecked Keep source prefixes as folder structure option and the Connect 2 files button.
The Connect files to filespace dialog shows two files from the bucket, the destination folder /incoming/spring-campaign, the unchecked Keep source prefixes as folder structure option and the Connect 2 files button.

Click the connect button, for example Connect 2 files. Files connect one at a time, and the dialog stays open until the run ends (but can be dismissed without killing the job). When all of the files connect, the dialog closes and a message confirms it; in the desktop app, its Open folder button opens the destination in your file manager. The desktop app shows new files after its next sync.

If some files fail, the dialog lists each one with its reason, for example "A file with this name already exists in this folder. Rename it or choose another folder." Existing files are never overwritten. Fix the cause, then click the retry button, for example Retry 1 file.

The dialog titled 1 file couldn't connect lists teaser_v2.mov with the reason that a file with this name already exists in the folder, and shows a Retry 1 file button.
The dialog titled 1 file couldn't connect lists teaser_v2.mov with the reason that a file with this name already exists in the folder, and shows a Retry 1 file button.

Connect files by object key

An object key is the file's full path inside the bucket, without the bucket name, for example projects/2026/spring-campaign/hero_v3.mov.

When the data store's keys lack s3:ListBucket, opening it shows a No browsing for screen naming the bucket, with a Connect files button. You can also click Connect files on the LucidLink Connect page, choose the Data store, then Enter object keys.

The No browsing screen for acme-media-archive explains that the data store couldn't list the bucket's contents and offers a Connect files button for connecting files by object key.
The No browsing screen for acme-media-archive explains that the data store couldn't list the bucket's contents and offers a Connect files button for connecting files by object key.

In Object keys, enter keys, s3:// addresses in this bucket, or https:// addresses on the data store's own endpoint, such as https://acme-media-archive.s3.eu-central-1.amazonaws.com/projects/2026/spring-campaign/hero_v3.mov. Separate entries with a comma, a space or Enter. To enter a key that contains a space, paste it: pasted text splits only at commas.

The Connect files to filespace dialog in object-key mode shows two object keys entered as tags in the Object keys field, the destination folder /incoming, the unchecked Keep source prefixes as folder structure option and the Connect 2 files button.
The Connect files to filespace dialog in object-key mode shows two object keys entered as tags in the Object keys field, the destination folder /incoming, the unchecked Keep source prefixes as folder structure option and the Connect 2 files button.

Choose the Destination folder as above. Each file lands at its full key path under it: with /incoming, the key projects/2026/spring-campaign/hero_v3.mov becomes /incoming/projects/2026/spring-campaign/hero_v3.mov, whatever Keep source prefixes as folder structure says. Click the connect button.

The app checks only the format of each key. A key with no object fails when you connect, with "You are not allowed to read this object from the bucket." or "This file couldn't be connected."

Connect files from HTTP links

Each link must:

  • Start with https:// and point at the file itself, not at a share or preview page.
  • Come from a host that reports the file size (the Content-Length header) and lets apps download part of a file (byte-range requests).
  • In the web app, come from a host whose CORS policy allows requests from https://app.lucidlink.com, both to connect and to open the file. The desktop app does not need this.

Open an HTTP data store and click Connect files. In HTTP links, enter your links. Each becomes a file named after the last part of the link's path, without anything after a ? (for example cut_04.mov); rename it with the pencil. Two links in one batch cannot share a file name.

Choose the Destination folder and click the connect button; files land directly in it.

The Connect files to filespace dialog for an HTTP data store shows two links in the HTTP links field, one file card for each link, the destination folder /incoming/review and the Connect 2 files button.
The Connect files to filespace dialog for an HTTP data store shows two links in the HTTP links field, one file card for each link, the destination folder /incoming/review and the Connect 2 files button.

If a link fails, it turns red in HTTP links. Hover over it to see the reason, fix or remove the link, then click the retry button, for example Retry 1 file.

LucidLink uses each link as-is and never renews it. When a link expires or changes, the external file stops opening. Delete the external file and connect the new link, or update the link in place through the LucidLink API (see HTTP link files on the Developer Portal).

When you paste links or object keys, only commas separate entries, and an entry can contain spaces. A pasted list with one entry per line becomes a single entry.

Working with external files

External files open, stream, pin and cache like any other file, for everyone with access to their folder, standard users included. Nobody who opens them receives your storage keys.

In the web app's file browser, external files carry a small LucidLink Connect badge on their icon. With the desktop app, macOS Finder shows an "External File" badge and Windows File Explorer shows an overlay icon. The iOS and Android apps show an icon on external files in the file list.

The web app file browser shows two files, and only hero_v3.mov, an external file, carries the LucidLink Connect badge on its icon.
The web app file browser shows two files, and only hero_v3.mov, an external file, carries the LucidLink Connect badge on its icon.

Moving, renaming, or deleting an external file in the filespace does not affect the data in the source.

Snapshots include external files, but access URLs inside a snapshot are not renewed. Files from S3 data stores stop opening there after the URL expiration, and files from HTTP links stop opening there when their link expires.

Manage and delete data stores

To change the keys of an S3 data store, select Manage data store, replace the Access key if it changed, enter the Secret access key, and click Save changes. If files are already connected, LucidLink tests the new keys against one of them and rejects wrong keys, or keys without s3:GetObject, with "Storage credentials pair is invalid." Otherwise the next bucket listing tests them.

LucidLink then refreshes the access URLs of external files in the background. Keep the old keys active for the data store's URL expiration (7 days by default); if you revoke them sooner, external files stop opening until the refresh reaches them.

The other details are read-only. To change them, delete the data store and add a new one. Deleting removes its external files, and the app has no list of them, so note them first and connect them again from the new data store.

The Manage data store dialog shows an editable access key, an empty secret access key field, read-only provider, bucket and region details, a Delete data store button and a disabled Save changes button.
The Manage data store dialog shows an editable access key, an empty secret access key field, read-only provider, bucket and region details, a Delete data store button and a disabled Save changes button.

To remove a data store, select Delete data store. Files connected from it are removed from LucidLink; the files in your storage are not deleted. Type the data store name and click Yes, delete data store.

The Delete data store acme-media-archive? dialog states that external files are removed from LucidLink but not from the data store, with the data store name typed in the confirmation field.
The Delete data store acme-media-archive? dialog states that external files are removed from LucidLink but not from the data store, with the data store name typed in the confirmation field.

The app then disconnects each external file and removes the data store, showing progress in a notification; keep the app open until it confirms. Cancel stops the run while files are being disconnected; disconnected files stay disconnected and the data store stays. If some files are locked or you lack permission to remove them, the notification reads Data store deletion failed and the data store stays. Resolve the cause and delete it again; only the remaining files are disconnected.

Limits and troubleshooting

Limits

  • Up to 1000 data stores may be created per filespace, each with a unique name of 1 to 64 characters.
  • Changes to objects from the bucket side may break reading of external files in the filespace or cause unpredictable behavior and should be avoided once an object is linked.
  • Bucket search covers the current folder only.
  • Connected files cannot be listed through the web and desktop management UI currently and may only be browsed through the filesystem or listed using the API and/or SDK.
  • Linking of HTTP files does not automatically refresh their URLs, and any files linked using this method will break once the links expire if they have a limited lifespan.
  • Files linked via S3 have their links refreshed automatically and will remain accessible provided the linking credentials remain valid and the objects are unaltered on the bucket side.
  • Only HTTPS-based URLs are supported.
  • Certain providers whose CORS policies are not configurable are currently incompatible with listing and linking through the web and desktop apps (linking via the API, SDK, and CLI remain unaffected).
  • Linking the contents of a bucket through the web or desktop app does not create infrastructure to watch the bucket for changes, so only the selected objects are added. Any newly added objects will not be linked automatically. These kinds of automations must be accomplished using the API.

Troubleshooting

  • A "Can't reach [bucket name]" screen: wrong keys, an unreachable or http:// endpoint, or, in the web app only, a blocking CORS policy. Fix the keys under "Manage data store", then click Retry. To change the bucket, region or endpoint, delete the data store and add a new one.
  • A "No browsing for [bucket name]" screen: the keys lack s3:ListBucket. Connect by object key or add the permission.
  • "We couldn't load the bucket objects. Please try again later.": no bucket with that name exists, or the request failed. Click Retry. For a wrong bucket name, delete the data store and add a new one.
  • Something works in the desktop app but not in the web app, or every file fails in the web app with "This file couldn't be connected.": the CORS policy of the bucket or HTTP link host does not allow the web app or does not expose an ETag or Content-Length header.
  • A file fails with "You are not allowed to read this object from the bucket.": the keys lack s3:GetObject for it, or no object exists at that key. Fix the permission or the key and connect again.
  • An external file stopped opening: the object changed or was deleted in your bucket (delete the external file, then connect the object again once it is in the bucket), the keys were revoked (update them under Manage data store), or an HTTP link expired (delete the external file and connect the new link).

External files stay in your storage in their native format, without LucidLink client-side encryption, so LucidLink's zero-knowledge guarantee does not cover them: LucidLink Connect operates under a trusted service-provider model. The guarantee still covers all other data in the filespace.

LucidLink stores S3 data store keys in an encrypted form and uses them to generate access URLs. For HTTP links (such as pre-signed URLs that you generate yourself or obtain from a provider's API) LucidLink holds no credentials, and the links are encrypted so that LucidLink cannot read them.

Related articles

Questions?

If you still have questions, don't hesitate to reach out to Support or your Customer Success Account Manager.

Was this article helpful?

0 out of 0 found this helpful