Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking β€œSign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

perf: improve loading performance when large files are in picker #3497

Draft
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

timothycarambat
Copy link
Member

Pull Request Type

  • ✨ feat
  • πŸ› fix
  • ♻️ refactor
  • πŸ’„ style
  • πŸ”¨ chore
  • πŸ“ docs

Relevant Issues

closes #3416

What is in this change?

Adds a conditional way to load/parse file metadata that is placed into the picker by streaming json content when the file is larger than 10MB of content

Additional Information

Developer Validations

  • I ran yarn lint from the root of the repo & committed changes
  • Relevant documentation has been updated
  • I have tested my code functionality
  • Docker build succeeds locally

@timothycarambat timothycarambat mentioned this pull request Mar 19, 2025
10 tasks
@timothycarambat
Copy link
Member Author

timothycarambat commented Mar 19, 2025 β€’

@marcin-golebiowski can you see if this PR works or crashes for your files? I dont have any local files that would cause such a large JSON object. This should prevent loading of the pageContent into memory resulting in OOM execptions

@marcin-golebiowski
Copy link

No crashes any more. Tested on 38 MB file. I'm wondering if reading all the files is necessary to display them in the My documents window.

@timothycarambat
Copy link
Member Author

That would be also addressed in #3135

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants