✅ test: add unit test for packages/web-crawler/src/crawImpl/browserless.ts

[gru-agent]

Trigger Info

Trigger Type	Triggered By	Source Pull Request	Assignment
PR Created	arvinxx	6831	Detail

Summary

This PR introduces unit tests for the browserless function in the web-crawler package. The tests cover various scenarios to ensure the function behaves as expected under different conditions. Key highlights include:

• Environment Variable Validation: Tests to ensure the function throws an error when required environment variables (BROWSERLESS_URL or BROWSERLESS_TOKEN) are missing.

• Error Handling: Verifies that the function returns undefined when:

  • The fetch request fails.

  • The fetched content is empty.

  • The page title is "Just a moment...".

• Successful Crawl: Confirms that the function returns the correct crawl result when the fetch is successful and the content is valid.

• Request Parameters: Ensures the function makes requests with the correct parameters, including the default BROWSERLESS_URL when not explicitly set in the environment variables.

These tests improve the reliability and robustness of the browserless function by validating its behavior across a range of edge cases and normal operations.

Tip

You can @gru-agent and leave your feedback. TestGru will make adjustments based on your input

Tip

You can @gru-agent rebase to rebase the PR.

Tip

You can @gru-agent redo to reset or rebase before redoing the PR.

Tip

To modify the test code yourself, click here Edit Test Code

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

3 Skipped Deployments

Name	Status	Preview	Comments	Updated (UTC)
lobe-chat-database	⬜️ Ignored (Inspect)	Visit Preview		Mar 9, 2025 10:27am
lobe-chat-desktop	⬜️ Ignored (Inspect)	Visit Preview		Mar 9, 2025 10:27am
lobe-chat-preview	⬜️ Ignored (Inspect)	Visit Preview		Mar 9, 2025 10:27am

[lobehubbot]

👍 @gru-agent[bot]

Thank you for raising your pull request and contributing to our Community
Please make sure you have followed our contributing guidelines. We will review it as soon as possible.
If you encounter any problems, please feel free to connect with us.
非常感谢您提出拉取请求并为我们的社区做出贡献，请确保您已经遵循了我们的贡献指南，我们会尽快审查它。
如果您遇到任何问题，请随时与我们联系。

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 97.57%. Comparing base (00cba71) to head (6425efc).
Report is 13 commits behind head on main.

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #6834      +/-   ##
==========================================
+ Coverage   91.35%   97.57%   +6.22%     
==========================================
  Files         728       14     -714     
  Lines       68388     3676   -64712     
  Branches     3106      205    -2901     
==========================================
- Hits        62475     3587   -58888     
+ Misses       5913       89    -5824     

Flag	Coverage Δ
app	?
server	97.57% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

[gru-agent]

✅ Rebase TestGru PR Success

Type	Change
Base Sha	b3468a9...5fdb3a2
Head Sha	4b87016...94a960c

[lobehubbot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

🔄 Rebasing Testgru per ...

[gru-agent]

✅ Rebase TestGru PR Success

Type	Change
Base Sha	b3468a9...5fdb3a2
Head Sha	4b87016...6425efc

[lobehubbot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

🔄 Rebasing Testgru per ...

[gru-agent]

❌ Rebase test pr failed: Error: Pull request #6834 has conflicts. you can use @gru-agent redo to redo.

[lobehubbot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

🔄 Rebasing Testgru per ...