SGavrl
e7bb0c676d
Picks up @Timtech4u's PR #33, which has been waiting since April. The design (CLI flag + threading through BrowserContext + http client) is theirs and is correct; this is a clean rewrite on top of current main because repeated rebase rounds had been reverting unrelated work that landed in the meantime. Issue #4 blocked all loopback / RFC1918 / link-local fetches to prevent SSRF. The only escape was OBSCURA_ALLOW_PRIVATE_NETWORK=1, which is process-wide and clunky in pipelines. Multiple users (@Timtech4u in the original PR, then @duartemvix and @necrogami in the comment thread) reported they cannot use obscura for development against http://localhost:N without it. Adds --allow-private-network as a global CLI flag, works on fetch, serve, and scrape. Threads through BrowserContext::with_storage_and_network and the http client's validate_url. CdpContext gets a new_full builder and obscura_cdp::start_with_full_serve_options entry point so 'obscura serve --allow-private-network' lets Puppeteer/Playwright navigate to localhost too. Default remains blocked. Backward compat: the env var still works (OR'd with the flag inside validate_url). All existing constructors and entry points unchanged. Verified end-to-end against a local http.server on 127.0.0.1: fetch and CDP Page.navigate both blocked by default, both succeed with the flag. Public URLs unaffected. Integration suite 28/28, full workspace cargo test all green.
20 lines
555 B
Rust
20 lines
555 B
Rust
pub mod client;
|
|
pub mod cookies;
|
|
pub mod encoding;
|
|
pub mod interceptor;
|
|
pub mod robots;
|
|
pub mod blocklist;
|
|
#[cfg(feature = "stealth")]
|
|
pub mod wreq_client;
|
|
|
|
pub use client::{
|
|
env_allows_private_network, ObscuraHttpClient, ObscuraNetError, RequestInfo, ResourceType,
|
|
Response,
|
|
};
|
|
pub use cookies::{CookieInfo, CookieJar};
|
|
pub use encoding::{decode_non_html, decode_response};
|
|
pub use robots::RobotsCache;
|
|
pub use blocklist::is_blocked as is_tracker_blocked;
|
|
#[cfg(feature = "stealth")]
|
|
pub use wreq_client::{StealthHttpClient, STEALTH_USER_AGENT};
|