ComfyUI Node
Web Image Scraper v0.82
A ComfyUI node in download-tools/Scrapers with 49 inputs and 14 outputs.
Web Image Scraper v0.82
- output_path
- metadata_json_path
- files_found
- files_downloaded
- videos_downloaded
- duplicates_removed
- duplicates_moved
- skipped_small
- skipped_platform
- skipped_not_media
- skipped_already_processed
- failed_download
- screenshots_taken
- stats_summary
◄url►
◄output_dirweb_scraper_output►
◄min_width512►
◄min_height512►
◄max_files1000►
◄download_imagestrue►
◄download_videostrue►
◄same_domain_onlytrue►
◄filename_prefixWS81_►
◄use_direct_playwrighttrue►
◄continue_last_runfalse►
◄use_url_as_foldertrue►
◄move_duplicatesfalse►
◄hash_algorithm▾►
◄extract_metadatatrue►
◄save_metadata_jsontrue►
◄crawl_linksfalse►
◄crawl_depth1►
◄max_pages50►
◄crawl_subfolderstrue►
◄skip_first_page_downloadfalse►
◄link_include_pattern►
◄link_exclude_pattern►
◄download_audiofalse►
◄metadata_export_formatjson►
◄timeout_seconds100►
◄handler_timeout120►
◄max_api_pages3►
◄wait_for_network_idlefalse►
◄playwright_wait_ms1000►
◄use_stealth_modefalse►
◄stealth_mode_levelbasic►
◄use_auto_scrolltrue►
◄max_auto_scrolls150►
◄scroll_down_times150►
◄scroll_delay_ms1000►
◄interaction_sequence—►
◄auth_config_path►
◄save_cookiesfalse►
◄take_screenshotfalse►
◄screenshot_elements—►
◄screenshot_full_pagefalse►
◄debug_modefalse►
◄use_paralleltrue►
◄max_workers4►
◄reuse_sessionstrue►
◄session_expiry_hours24►
◄capture_network_streamfalse►
◄dump_cache_after_runfalse►
Categorydownload-tools/Scrapers
Inputs (49)
| Name | Type | Default | Description |
|---|---|---|---|
| url | STRING | — | |
| output_dir | STRING | web_scraper_output | — |
| min_width | INT | 5120–10000 | — |
| min_height | INT | 5120–10000 | — |
| max_files | INT | 10000–5000 | — |
| download_images | BOOLEAN | true | — |
| download_videos | BOOLEAN | true | — |
| same_domain_only | BOOLEAN | true | — |
| filename_prefix | STRING | WS81_ | — |
| use_direct_playwrightopt | BOOLEAN | true | — |
| continue_last_runopt | BOOLEAN | false | — |
| use_url_as_folderopt | BOOLEAN | true | — |
| move_duplicatesopt | BOOLEAN | false | — |
| hash_algorithmopt | COMBO | 4 options: average_hash, phash, dhash, whash | |
| extract_metadataopt | BOOLEAN | true | — |
| save_metadata_jsonopt | BOOLEAN | true | — |
| crawl_linksopt | BOOLEAN | false | — |
| crawl_depthopt | INT | 11–5 | — |
| max_pagesopt | INT | 501–500 | — |
| crawl_subfoldersopt | BOOLEAN | true | — |
| skip_first_page_downloadopt | BOOLEAN | false | — |
| link_include_patternopt | STRING | — | |
| link_exclude_patternopt | STRING | — | |
| download_audioopt | BOOLEAN | false | — |
| metadata_export_formatopt | COMBO | json | 3 options: json, csv, md |
| timeout_secondsopt | FLOAT | 1005–600 | — |
| handler_timeoutopt | FLOAT | 12010–1200 | — |
| max_api_pagesopt | INT | 31–100 | — |
| wait_for_network_idleopt | BOOLEAN | false | — |
| playwright_wait_msopt | INT | 10000–60000 | — |
| use_stealth_modeopt | BOOLEAN | false | — |
| stealth_mode_levelopt | COMBO | basic | 3 options: basic, enhanced, extreme |
| use_auto_scrollopt | BOOLEAN | true | — |
| max_auto_scrollsopt | INT | 1500–500 | — |
| scroll_down_timesopt | INT | 1500–200 | — |
| scroll_delay_msopt | INT | 100050–5000 | — |
| interaction_sequenceopt | STRING | — | |
| auth_config_pathopt | STRING | — | |
| save_cookiesopt | BOOLEAN | false | — |
| take_screenshotopt | BOOLEAN | false | — |
| screenshot_elementsopt | STRING | — | |
| screenshot_full_pageopt | BOOLEAN | false | — |
| debug_modeopt | BOOLEAN | false | — |
| use_parallelopt | BOOLEAN | true | — |
| max_workersopt | INT | 41–16 | — |
| reuse_sessionsopt | BOOLEAN | true | — |
| session_expiry_hoursopt | FLOAT | 241–720 | — |
| capture_network_streamopt | BOOLEAN | false | — |
| dump_cache_after_runopt | BOOLEAN | false | — |
Outputs (14)
| Name | Type | Description |
|---|---|---|
| output_path | STRING | — |
| metadata_json_path | STRING | — |
| files_found | INT | — |
| files_downloaded | INT | — |
| videos_downloaded | INT | — |
| duplicates_removed | INT | — |
| duplicates_moved | INT | — |
| skipped_small | INT | — |
| skipped_platform | INT | — |
| skipped_not_media | INT | — |
| skipped_already_processed | INT | — |
| failed_download | INT | — |
| screenshots_taken | INT | — |
| stats_summary | STRING | — |