feat(project-files): let Chat read and write Project files by mzxchandra · Pull Request #9034 · simstudioai/sim

mzxchandra · 2026-10-14T18:42:59Z

Summary

Lets Chat read, search, write, upload and copy Project files, on top of the Project files backend that #9015 through #9019 merged.
Everything stays behind the projects flag, which turns on only after the project-first redesign ships its Project files UI.

Scope: backend and Chat transport only.
The Project file browser and other Project UI were removed from this PR, because the redesign will build that surface project-first rather than inside the workspace Files page.
The removed UI is preserved at the project-files-ui-seed tag for that work.
The only client change left is the shared ChatContext wire type (Project contexts and file owners) and its kind registry entry.

What Chat can do with Project files

Discover the user's Projects (projects list) and target one explicitly per command with --project <id>.
Read, view and grep Project files, write and upload them from the workbench sandbox, and copy files between workspaces and Projects.
Accept Project and Project file tags in a user's message.

Secret handling matches workspace files

Project text reads and grep now redact secrets the way workspace text reads do, instead of refusing any file that contains one.
One text extraction core is shared by workspace text reads and private file observation: parse, redact before a line window can cut a secret, then slice.
readProjectFileText admits the source and every rendered input as complete text and returns text only, so bytes never leave under a complete label.
readProjectFileArtifact still admits opaque bytes, so visual and byte reads of a file with a secret are still refused.

Flag gating

Project sandbox callbacks now run under the same workbench content gate as workspace callbacks, since staging treats resource-delegated Chat principals as Chat.
The chat resources API refuses new Project tabs while Projects are off; removing or reordering stored tabs still works.
Every other Chat path to Project data already checks the flag: worker hints, list_user_projects, Project file use cases, and sandbox callbacks.
A flag check in list_user_projects that could never run was removed.

Pairing with simstudioai/mothership#594
This PR and the worker companion merge back to back, Sim first.
Sim sends file-owner hints only when the worker's health check advertises the file-owner protocol, so merging Sim first changes nothing at runtime.
The worker byte-checks Sim's copies of the generated contracts, so the pair must land together; the companion pin will point at this PR's head on staging.

Type of Change

New feature
Other: removes the Project files UI from scope

Testing

Typecheck, repository audits and the test-types ratchet pass.
Unit suites for the touched areas pass (427 files).
Project and content integration suites pass against disposable PostgreSQL, including Project reads, grep, write transport, account deletion and private purge.
New integration coverage checks that a Project file with a secret is masked at the model egress for full reads, never leaks through a line-range read, still matches grep on its other lines, and is refused for byte reads.
Locally, nine generated-document archive tests time out because the isolated document worker is unavailable; they time out identically on the commit before this change.
Staging verification with Projects off: pre-deploy fixtures are seeded and the old release passes all three Chat checks (grep masks a workspace secret, a ranged read shows the secret's name instead of its value, a sandbox read succeeds); the post-deploy run follows once this pair is serving.
E2B and Daytona acceptance of the Project workbench flow is still outstanding and gates the flag flip, not this merge.

Reviewers: focus on readProjectFileText and the artifact view factory in artifacts.ts, the shared extractFileTextFromBytes, and the Project sandbox callback gate.

Checklist

Code follows project style guidelines
Self-reviewed my changes
Tests added/updated and passing
No new warnings introduced
I confirm that I have read and agree to the terms outlined in the Contributor License Agreement (CLA)

🤖 Generated with Claude Code

vercel · 2026-10-14T18:43:05Z

The latest updates on your projects. Learn more about Vercel for GitHub.

Project	Deployment	Actions	Updated
docs	Ready	Preview	Oct 16, 2026 5:47am UTC

- Keep prepareProjectsForAccountDeletion returning the Project IDs to delete. The object return added an unused storageCleanupEventIds field; the durable cleanup outbox already processes those events, so restore the staging contract and its stronger integration assertions. - Exempt lib/mothership/generated from the relative-import convention. contracts:sync copies those wire contracts verbatim and byte-checks them, so their sibling imports must stay relative; drop their baseline rows. - Re-record the files page module-count baseline for the Project browser. - Type the test fixtures that regressed, including a queue-recovery fixture that persisted the invalid completion status 'success'.

Staging now holds resource-delegated Chat principals to content admission, so a Project callback read with no gate was refused and the sandbox got a 503. Run Project callbacks under the same workbench session gate as workspace callbacks (the gate's workspace is optional, since Projects have none) and share the withheld-result handling. The Project CLI read suite now runs reads under the tool executor's registry gate, as Chat does.

The chat resources API stored a Project-owned tab without checking the projects flag. Refuse new Project tabs while Projects are off; removing or reordering stored tabs stays possible so they can be cleaned up. Also drop the projects flag check in list_user_projects that could never run (listProjects already refuses while the flag is off) and the content delivery barrel export left unused by the shared sandbox delivery helper.

The Project files UI will be built for the project-first redesign, so this PR keeps only the backend and Chat transport behind the projects flag. Restore the workspace Files page, file viewer, Chat resource panel, add-resource and mention entries, and their client query hooks and owner adapters to staging. The previous tip is tagged project-files-ui-seed for that UI work. Kept: the shared ChatContext wire type (Project contexts and file owners reach the Chat server) and its exhaustive kind registry entry. Also drop the UI-only browser constants and response types nothing uses now, restore the files page module-count baseline, and type the use-chat fixtures that returned with the staging test.

Project grep and text reads admitted every Project artifact as opaque bytes, so any file carrying a secret was refused to Chat instead of having the secret masked, unlike the same file in a workspace. Share one text extraction core between workspace text reads and private file observation: parse, redact before a line window can cut a secret, then slice. Project text reads now go through readProjectFileText, which admits the source and every rendered input as complete text and returns text only. The complete artifact read stays private to that use case, so bytes never leave under a complete label; readProjectFileArtifact keeps admitting opaque bytes, and visual reads of a secret still refuse.

…s-product-v2 # Conflicts: # apps/sim/lib/mothership/request/application/recover-stream.ts

mzxchandra · 2026-10-15T22:59:50Z

@greptile

mzxchandra · 2026-10-15T22:59:51Z

@cubic-dev-ai review this PR

cubic-dev-ai · 2026-10-15T22:59:59Z

@cubic-dev-ai review this PR

@mzxchandra I have started the AI code review. It will take a few minutes to complete.

cubic-dev-ai

1 issue found across 116 files

Confidence score: 3/5

In workspace.ts, organization-target workbench receipts may not be scoped and audited to the selected workspace when the chat provides only chatOrganizationId. Pass organizationId: context.chatOrganizationId ?? context.organizationId.

Prompt for AI agents (unresolved issues)


Check if these issues are valid — if so, understand the root cause of each and fix them. When an issue isn't valid or won't be fixed in this PR, reply in its thread with the reason and then resolve the thread. If appropriate, use sub-agents to investigate and fix each issue separately.


<file name="apps/sim/lib/mothership/agent-cli/workspace.ts">

<violation number="1" location="apps/sim/lib/mothership/agent-cli/workspace.ts:59">
P2: Organization-target workbench receipts are scoped and audited to the selected workspace when the chat provides only `chatOrganizationId`. Pass `organizationId: context.chatOrganizationId ?? context.organizationId` so receipts retain organization scope across targets and audit records identify the owning organization.</violation>
</file>

_{Reply with feedback, questions, or to request a fix.

Turn on auto-fix | Re-trigger cubic}

…tory #9057 hid the projects group from --help and `sim cli` search until launch, and the inventory printer dropped every hidden command, so the Mothership worker lost the Project file commands it routes --project to. List a hidden top-level group that is only unpublished, marked `unpublished`, so the worker can route to it once Sim enables Projects for a turn; other hidden commands stay out, and --help is unchanged.

- Dispatch CLI services before file-owner adapters, so a service that carries a file owner gets the services validation instead of a bridge error. The unreachable Project-side service check is removed. - Check caller-chosen names on Project file renames and folder create and update with the same secret-provenance gate as create and upload, including workbench history for sandbox callbacks. - Move first-message file panel resolution into resolveFileAttachment and replace the mock-only post test with a database-backed check of the saved tab.

mzxchandra · 2026-10-16T01:58:39Z

@greptileai review

mzxchandra · 2026-10-16T01:58:41Z

@cubic-dev-ai review

cubic-dev-ai · 2026-10-16T01:58:47Z

@cubic-dev-ai review

@mzxchandra I have started the AI code review. It will take a few minutes to complete.

mzxchandra · 2026-10-16T01:59:08Z

@greptile

mzxchandra · 2026-10-16T01:59:09Z

@cubic-dev-ai review this PR

cubic-dev-ai · 2026-10-16T01:59:15Z

@cubic-dev-ai review this PR

@mzxchandra I have started the AI code review. It will take a few minutes to complete.

cubic-dev-ai

All reported issues were addressed across 125 files

_{You've manually re-run cubic several times on this PR. Each manual re-review checks the full PR again and counts toward your usage quota. To preserve your usage limits, we recommend letting cubic automatically review new commits.

Turn on auto-fix | Re-trigger cubic}

# Conflicts: # scripts/check-source-conventions.ts

- The chat resource store now keys tabs with the chat's workspace as the fallback scope, so an unscoped tab and the same tab addressed by that workspace merge instead of duplicating. Upsert, remove and reorder all use the same identity. - Project file renames and folder writes recheck cancellation after the name check and never forward a cancelled write. - Leave the .claude and .cursor import rules to staging, whose source conventions check now exempts generated contract copies itself.

mzxchandra · 2026-10-16T02:19:30Z

@greptile

mzxchandra · 2026-10-16T02:19:31Z

@cubic-dev-ai review this PR

cubic-dev-ai · 2026-10-16T02:19:37Z

@cubic-dev-ai review this PR

@mzxchandra I have started the AI code review. It will take a few minutes to complete.

cubic-dev-ai

All reported issues were addressed across 122 files

_{You've manually re-run cubic several times on this PR. Each manual re-review checks the full PR again and counts toward your usage quota. To preserve your usage limits, we recommend letting cubic automatically review new commits.

Turn on auto-fix | Re-trigger cubic}

- Parse Project file renames and folder writes with their route contracts under the inline body limit before the name check, so an oversized body is refused instead of buffered. Only those routes copy the request. - Treat an equal file owner as unchanged when merging chat tabs, so a repeated upsert stays a no-op.

mzxchandra · 2026-10-16T05:18:58Z

@greptile

mzxchandra · 2026-10-16T05:19:00Z

@cubic-dev-ai review this PR

cubic-dev-ai · 2026-10-16T05:19:07Z

@cubic-dev-ai review this PR

@mzxchandra I have started the AI code review. It will take a few minutes to complete.

cubic-dev-ai

All reported issues were addressed across 122 files

_{You've manually re-run cubic several times on this PR. Each manual re-review checks the full PR again and counts toward your usage quota. To preserve your usage limits, we recommend letting cubic automatically review new commits.

Turn on auto-fix | Re-trigger cubic}

mzxchandra · 2026-10-16T05:43:15Z

@greptile

mzxchandra · 2026-10-16T05:43:16Z

@cubic-dev-ai review this PR

cubic-dev-ai · 2026-10-16T05:43:24Z

@cubic-dev-ai review this PR

@mzxchandra I have started the AI code review. It will take a few minutes to complete.

cubic-dev-ai

No issues found across 122 files

Confidence score: 5/5

Automated review surfaced no issues in the provided summaries.
No files require special attention.

_{You've manually re-run cubic several times on this PR. Each manual re-review checks the full PR again and counts toward your usage quota. To preserve your usage limits, we recommend letting cubic automatically review new commits.

Turn on auto-fix | Re-trigger cubic}

vercel Bot deployed to Preview October 14, 2026 18:49

View deployment

mzxchandra mentioned this pull request Oct 14, 2026

feat(project-files): add core storage and realtime operations #9016

Merged

6 tasks done

greptile-apps Bot mentioned this pull request Oct 14, 2026

feat(project-files): add rendered delivery and indexed search #9017

Merged

7 tasks done

This was referenced Oct 15, 2026

fix(file-doc): stop the permission resend loop and restore the 10 MB proxy body limit #9057

Merged

fix(project-files): hold the Project and permission-group locks shared for non-charging file operations #9058

Merged

mzxchandra mentioned this pull request Oct 15, 2026

feat(project-files): add cross-owner copy and bulk transfers #9018

Merged

waleedlatif1 mentioned this pull request Oct 15, 2026

fix(project-files): requeue rendered-artifact search after commit and trim Project read transactions #9063

Merged

6 tasks done

mzxchandra force-pushed the codex/project-files-sharing branch from f7da653 to 8e82431 Compare October 15, 2026 02:07

mzxchandra mentioned this pull request Oct 15, 2026

feat(project-files): add public sharing and protected delivery #9019

Merged

6 tasks done

Base automatically changed from codex/project-files-sharing to staging October 15, 2026 04:12

feat(files): restore Project file browser and Mothership integration

d66d69d

mzxchandra force-pushed the codex/project-files-product-v2 branch from dc1b9e6 to d66d69d Compare October 15, 2026 04:23

vercel Bot temporarily deployed to Preview October 15, 2026 04:24 Inactive

github-actions Bot added the requires-mothership-merge Has a companion PR on the mothership/copilot side — merge in lockstep label Oct 15, 2026

vercel Bot deployed to Preview October 15, 2026 04:43

View deployment

mzxchandra added 5 commits October 15, 2026 11:58

Merge remote-tracking branch 'origin/staging' into codex/project-file…

a3b3cc2

…s-product-v2 # Conflicts: # apps/sim/lib/mothership/request/application/recover-stream.ts

vercel Bot deployed to Preview October 15, 2026 23:04

View deployment

mzxchandra changed the title ~~feat(files): Project file browser and Mothership integration~~ feat(project-files): let Chat read and write Project files Oct 15, 2026

github-actions Bot removed the requires-mothership-merge Has a companion PR on the mothership/copilot side — merge in lockstep label Oct 15, 2026

cubic-dev-ai Bot reviewed Oct 15, 2026

View reviewed changes

vercel Bot temporarily deployed to Preview October 16, 2026 01:58 Inactive

cubic-dev-ai Bot reviewed Oct 16, 2026

View reviewed changes

Comment thread apps/sim/lib/mothership/chat/file-attachment.ts

Comment thread apps/sim/lib/mothership/agent-cli/project-file-write-transport.ts Outdated

mzxchandra added 2 commits October 15, 2026 19:13

Merge remote-tracking branch 'origin/staging' into rebase/product-v2

7651d14

# Conflicts: # scripts/check-source-conventions.ts

vercel Bot deployed to Preview October 16, 2026 02:23

View deployment

cubic-dev-ai Bot reviewed Oct 16, 2026

View reviewed changes

Comment thread apps/sim/lib/mothership/agent-cli/project-file-write-transport.ts Outdated

Comment thread apps/sim/lib/mothership/resources/types.ts

mzxchandra added 2 commits October 15, 2026 21:31

Merge remote-tracking branch 'origin/staging' into rebase/product-v2

63d3531

vercel Bot temporarily deployed to Preview October 16, 2026 05:18 Inactive

cubic-dev-ai Bot reviewed Oct 16, 2026

View reviewed changes

Comment thread apps/sim/lib/mothership/resources/types.ts

Merge remote-tracking branch 'origin/staging' into rebase/product-v2

571269e

cubic-dev-ai Bot reviewed Oct 16, 2026

View reviewed changes

vercel Bot deployed to Preview October 16, 2026 05:47

View deployment

mzxchandra requested a review from waleedlatif1 October 16, 2026 05:54

Conversation

mzxchandra commented Oct 14, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

Type of Change

Testing

Checklist

Uh oh!

vercel Bot commented Oct 14, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

mzxchandra commented Oct 15, 2026

Uh oh!

mzxchandra commented Oct 15, 2026

Uh oh!

cubic-dev-ai Bot commented Oct 15, 2026

Uh oh!

cubic-dev-ai Bot left a comment • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

mzxchandra commented Oct 16, 2026

Uh oh!

mzxchandra commented Oct 16, 2026

Uh oh!

cubic-dev-ai Bot commented Oct 16, 2026

Uh oh!

mzxchandra commented Oct 16, 2026

Uh oh!

mzxchandra commented Oct 16, 2026

Uh oh!

cubic-dev-ai Bot commented Oct 16, 2026

Uh oh!

cubic-dev-ai Bot left a comment • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

mzxchandra commented Oct 16, 2026

Uh oh!

mzxchandra commented Oct 16, 2026

Uh oh!

cubic-dev-ai Bot commented Oct 16, 2026

Uh oh!

cubic-dev-ai Bot left a comment • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

mzxchandra commented Oct 16, 2026

Uh oh!

mzxchandra commented Oct 16, 2026

Uh oh!

cubic-dev-ai Bot commented Oct 16, 2026

Uh oh!

cubic-dev-ai Bot left a comment • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

mzxchandra commented Oct 16, 2026

Uh oh!

mzxchandra commented Oct 16, 2026

Uh oh!

cubic-dev-ai Bot commented Oct 16, 2026

Uh oh!

cubic-dev-ai Bot left a comment

Choose a reason for hiding this comment

mzxchandra commented Oct 14, 2026 •

edited

Loading

vercel Bot commented Oct 14, 2026 •

edited

Loading

cubic-dev-ai Bot left a comment •

edited

Loading

cubic-dev-ai Bot left a comment •

edited

Loading

cubic-dev-ai Bot left a comment •

edited

Loading

cubic-dev-ai Bot left a comment •

edited

Loading