Skip to main content

Documentation Index

Fetch the complete documentation index at: https://docs.pipeshub.com/llms.txt

Use this file to discover all available pages before exploring further.

Local FS

Index files from a folder on your computer

✅ Ready📖 Documentation Available

What is this?

Local FS lets you point PipesHub at a folder on your computer so you can search the files in it from PipesHub chat and the knowledge base — just like any other connector. Three things to know up front:
  • PipesHub only reads the folder. It doesn’t move, rename, copy, or delete anything.
  • There’s no login. No password, no API key, no cloud account. You just give it a folder path.
  • It’s a personal connector — you set it up under Personal → Your Connectors, and the files you index are searchable by you inside PipesHub. It is not shared with the rest of your team.

Words you’ll see

WordMeans
FolderA regular folder on your machine (or on the machine running PipesHub).
InstanceOne Local FS setup pointing at one folder. You can have several — one per folder.
SyncThe moment PipesHub reads the folder and updates what it knows about your files.

One thing to check first — which computer?

The folder needs to be readable by the machine running the PipesHub connector, which isn’t always the same as the laptop in front of you.
How you run PipesHubWhat “the folder” means
PipesHub on your own laptopA normal folder path on your laptop, e.g. /Users/you/Documents/notes.
PipesHub Desktop appSame — a folder on your laptop.
PipesHub in Docker / KubernetesA folder that has been mounted into the container, e.g. host /data mounted as /data → use /data.
If you’re using Docker or a server deployment and you’re not sure, ask whoever set PipesHub up. If it’s just on your laptop, you’re fine — pick any folder.
Quick check for Docker users: docker compose exec <connectors-service> ls /path/you/will/use. If that lists your files, you’re good. If it says “No such file” or “Permission denied”, the folder isn’t mounted yet.

What you need before you start

  1. A PipesHub account where the left sidebar shows Personal → Your Connectors.
  2. A folder you want to make searchable.
  3. About 2 minutes. There’s no cloud setup at all.

Setup

Setup

Step 1 — Open Local FS in PipesHub

  1. In PipesHub, look at the left sidebar.
  2. Under Personal, click Your Connectors.
  3. Find the Local FS card.
  4. Click + Setup on the card.
Your Connectors catalog with Local FS and + Setup
A panel slides in from the right with two tabs: Authenticate Instance and Configure Records. You’ll fill them in order.
Local FS lives under Personal → Your Connectors, not Workspace → Connectors. If you don’t see it, scroll the connectors list or use the All / Active / Inactive filters at the top.

Step 2 — Name the instance (Authenticate Instance tab)

The first tab is Authenticate Instance. Local FS has no login, so you’ll see a banner that says No authentication required for this connector. That’s normal — there’s nothing to paste.
Authenticate Instance tab — no credentials needed
  1. In Instance name, type a short name you’ll recognise later (for example My laptop or Work notes).
  2. Click Next → at the bottom.
The instance name is just a label for you. Pick something descriptive — when you add a second folder later, this is how you’ll tell them apart.

Step 3 — Pick the folder and how often to sync (Configure Records tab)

The panel moves you to the Configure Records tab. This is the only tab where you actually have to make choices.
Configure Records tab with Sync settings and the Local folder field
Under Sync settings there are two choices:
  • Sync Strategy
    • Scheduled — PipesHub rescans the folder on its own. (Recommended.)
    • Manual — only rescans when you press Sync / Full sync yourself.
  • Sync Interval — how often a scheduled sync runs. 1 Hour is a good starting point.
Under Additional settings:
  • Local folder — the path to the folder you want to index. Use Choose folder if a picker is shown, or type the path directly. Make sure it’s a path the PipesHub connector can see (see “Which computer?” above).
  • Include subfolders — leave this on to index everything inside the folder. Turn it off to index only the files at the top level.
  • Batch size — leave it as the default unless someone has told you otherwise.
Not sure what to pick? Scheduled, 1 Hour, Include subfolders ON, batch size as-is — that’s the right answer for most people.
Just turning the connector “on” later won’t read your files by itself. PipesHub still needs either a manual sync or a schedule to actually walk the folder. Step 6 covers running a sync.

Step 4 — (Optional) Narrow down what gets synced

If your folder has lots of files you don’t care about (build outputs, photos, downloads), you can tell PipesHub to skip them.Scroll to Indexing & sync filters and click + Add filter.
Indexing & sync filters with + Add filter
Common filters:
FilterWhat it doesWhen to use it
File ExtensionsOnly sync certain file types. Comma-separated, e.g. pdf, docx, txt.You only want documents — not images, videos, archives.
Modified DateOnly sync files changed after / before / between certain dates.You want to skip very old files.
Created DateSame idea as Modified Date but for the original creation time.Same idea, different timestamp.
Each filter has an operator — usually In (“only these”) or Not In (“everything except these”).Quick examples:
  • PDFs onlyFile Extensions · In · pdf
  • Skip images and archivesFile Extensions · Not In · jpg, png, gif, zip
  • Last year onlyModified Date · After · pick a date
When you’re done, click Save Configuration at the bottom of the panel.
No filters? That’s fine for small folders. PipesHub will just sync everything it can read.

Step 5 — Turn sync on

After you save, you’ll land on the Local FS instance page with one row — your new instance.
Local FS instance row with Sync Enabled toggle
Right now the row shows Sync Paused — nothing is happening yet.
  1. Find the Sync Enabled toggle on the right of the row.
  2. Click it on.
The status flips to Sync Enabled and PipesHub is ready to scan your folder.

Step 6 — Run the first sync and watch progress

Click anywhere on the instance row to open the Overview panel on the right.
Overview panel with record stats and sync actions
If you picked Manual sync strategy in Step 3, click Sync or Full sync here to kick off the first crawl. If you picked Scheduled, the next sync will run at the interval you set (or click Sync if you don’t want to wait).In the panel you can see:
  • Total — how many files PipesHub has found.
  • Completed — files that are fully indexed and searchable.
  • Processing — files being read right now.
  • Queued / Not Started — files waiting their turn.
  • Failed — files PipesHub couldn’t read (usually a permission issue, or a corrupt/protected file).
  • Sync / Full sync — re-run a sync any time. Full sync rescans everything; Sync picks up only what’s changed.
  • Manage Configuration — re-opens the two tabs from Steps 2–4 if you want to change the folder or filters later.
That’s it! 🎉 Once Processing and Queued drop to zero, your folder is fully searchable in PipesHub.

First sync (full scan)

The first time, PipesHub walks every file in the folder you chose (and every subfolder, if you left that option on). Bigger folders take longer:
Number of filesRoughly how long
Under 1,000A few minutes
1,000 – 10,00010 – 30 minutes
10,000 – 100,00030 minutes – 2 hours
Over 100,000Several hours
Tip: filtering by file extension (e.g. PDFs only) makes the first sync dramatically faster.

Later syncs (just what changed)

After the first sync, PipesHub only looks at what’s different since last time:
  • New files — added to search.
  • Edited files — re-indexed.
  • Deleted files — removed from search.
These are usually quick.

Who can see the synced files?

Local FS is registered as a personal connector. Only your PipesHub user can search the files indexed by your instance. It does not change permissions on disk in any way.

Scheduled vs Manual

Scheduled runs on its own at the interval you picked. Set it once and forget about it.Manual only runs when you click Sync or Full sync. Useful when:
  • You just dropped a batch of files into the folder and want them searchable now.
  • You’re testing filter changes.

Fully searchable (text inside the file)

These get parsed so you can search the actual contents:
  • Documents — PDF, DOCX, PPTX, XLSX, ODT, RTF
  • Plain text — TXT, MD, CSV, JSON, XML, HTML
  • Code — .py, .js, .ts, .java, and most others

Stored but not searched inside

These show up by filename and metadata, but their contents aren’t indexed:
  • Images (JPG, PNG, GIF, …)
  • Video and audio
  • Archives (ZIP, RAR, …)
  • Other binary files
Password-protected PDFs and Office files can’t be indexed unless they’re unlocked.

Troubleshooting

This almost always means the path is on your laptop but PipesHub is running somewhere else (Docker, a server, Kubernetes).
  • If you’re using Docker: the folder must be mounted into the container. Test with docker compose exec <connectors-service> ls /your/path.
  • Check Windows vs Mac/Linux path style matches the OS the connector is running on (e.g. don’t paste C:\Users\... into a Linux container).
  • Make sure the user the connector runs as has read permission on the folder.
  • The folder might genuinely be empty, or all the files might live in subfolders while Include subfolders is off.
  • Your filters might be excluding everything — open Manage Configuration and double-check.
  • Confirm the files exist where you think they do (ls on Mac/Linux, File Explorer on Windows) on the machine running the connector.
  • Make sure Sync Strategy is set to Scheduled and Sync Interval has a value.
  • Confirm Sync Enabled on the instance card is on (not paused).
  • Check the connector process is running and healthy.
If you moved PipesHub to a new server or container, the old folder path probably doesn’t exist there.
  • Re-mount your folder in the new environment (or copy the files).
  • Open the instance, click Manage Configuration, update Local folder to the new path, and save.

Frequently asked questions

No. The connector only reads files to build search records. It never writes back to your folder.
Local FS is registered as a personal connector — only your PipesHub user can search files indexed by your instance. For team-wide file sharing, use a cloud connector (S3, GCS, Azure Blob, Google Drive, OneDrive, etc.).
On the next sync, PipesHub notices it’s gone and removes it from search.
Yes. On the Local FS instance page click + Add Another Instance, give it a different name, and point it at a different path. Each instance has its own filters and its own on/off toggle.
The path is saved in your PipesHub configuration. There are no credentials to leak — only the path string itself.