Skip to content

docs: Add anti-blocking guide#961

Merged
Pijukatel merged 4 commits into
masterfrom
antiblocking-guide
Feb 12, 2025
Merged

docs: Add anti-blocking guide#961
Pijukatel merged 4 commits into
masterfrom
antiblocking-guide

Conversation

@Pijukatel

Copy link
Copy Markdown
Collaborator

Description

Add anti-blocking guide for Python.
(Adaptation of JS version of the guide: https://crawlee.dev/docs/guides/avoid-blocking)

Issues

@Pijukatel Pijukatel added documentation Improvements or additions to documentation. t-tooling Issues with this label are in the ownership of the tooling team. labels Feb 6, 2025
@github-actions github-actions Bot added this to the 107th sprint - Tooling team milestone Feb 6, 2025
@Pijukatel Pijukatel marked this pull request as ready for review February 6, 2025 10:50
@Pijukatel Pijukatel requested review from janbuchar and vdusek February 6, 2025 10:50
Comment thread docs/guides/avoid_blocking.mdx Outdated
Comment on lines +32 to +34
### Disabling browser fingerprints

By default, fingerprints are disabled.

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Section with 5 words looks terrible, either extend or remove it.

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You are right. Rephrased and added to the previous section.


By default, fingerprints are disabled.

## Using Camoufox

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe we can link python/docs/examples/playwright-crawler-with-camoufox ?

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It is imported in line 11 and directly showed as code block.

@Pijukatel Pijukatel requested a review from vdusek February 11, 2025 09:24

@vdusek vdusek left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@Pijukatel Pijukatel merged commit 207c983 into master Feb 12, 2025
@Pijukatel Pijukatel deleted the antiblocking-guide branch February 12, 2025 10:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation. t-tooling Issues with this label are in the ownership of the tooling team.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Create a new guide about how to not get blocked

2 participants