-
Notifications
You must be signed in to change notification settings - Fork 4.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
docs: fix technical inaccuracies in Local JSON destination documentation #55808
base: master
Are you sure you want to change the base?
docs: fix technical inaccuracies in Local JSON destination documentation #55808
Conversation
🤖 Devin AI EngineerOriginal prompt from [email protected]:
I'll be helping with this pull request! Here's what you should know: ✅ I will automatically:
Note: I can only respond to comments from users who have write access to this repository. ⚙️ Control Options:
|
The latest updates on your projects. Learn more about Vercel for Git ↗︎
|
airbyte-integrations/connectors/destination-local-json/src/main/resources/spec.json
Outdated
Show resolved
Hide resolved
…lumes first Co-Authored-By: [email protected] <[email protected]>
3. **Access Data After Sync Completion** | ||
- For completed pods where the data is stored in the persistent volume: | ||
``` | ||
kubectl --kubeconfig ~/.airbyte/abctl/abctl.kubeconfig --namespace airbyte-abctl run file-access --image=busybox --restart=Never -it --rm --volumes=local-json-data:/data -- /bin/sh -c "ls -la /data" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This part is incorrect. kubectl run does not support --volumes directly. You need to define a volume using a pod or deployment spec instead.
``` | ||
- To view file contents directly: | ||
``` | ||
kubectl --kubeconfig ~/.airbyte/abctl/abctl.kubeconfig --namespace airbyte-abctl exec -it file-access -- cat /data/your_stream_name/*.jsonl |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
What's the expected location of this file? My terminal tells me no matches are found.
- In the Airbyte UI, create or edit your connection to use this destination | ||
- **Important**: You must configure the destination pod to mount the PVC during sync: | ||
``` | ||
kubectl --kubeconfig ~/.airbyte/abctl/abctl.kubeconfig --namespace airbyte-abctl patch deployment airbyte-abctl-destination -p '{"spec":{"template":{"spec":{"volumes":[{"name":"data-volume","persistentVolumeClaim":{"claimName":"local-json-data"}}],"containers":[{"name":"airbyte-abctl-destination","volumeMounts":[{"name":"data-volume","mountPath":"/local"}]}]}}}}' |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Please check this. I get: Error from server (NotFound): deployments.apps "airbyte-abctl-destination" not found
…N destination Co-Authored-By: [email protected] <[email protected]>
This PR fixes technical inaccuracies in the Local JSON destination documentation, particularly regarding the default data write location and the LOCAL_ROOT environment variable. It updates the documentation to reflect Airbyte's current deployment architecture using abctl instead of docker-compose.
Link to Devin run: https://app.devin.ai/sessions/69d164d256f8438f80b5c11a52242fcf
Requested by: [email protected]