Code

Scraper uc#294

Code

Open

aravindkarnam wants to merge 226 commits intounclecode:scraper-ucunclecode/crawl4ai:scraper-ucfrom aravindkarnam:scraper-ucaravindkarnam/crawl4ai:scraper-ucCopy head branch name to clipboard

+31,443-74,020

Commits

Commits on Oct 17, 2024

• feat(crawler): Enhance stealth and flexibility, improve error handling

  Show description for 768aa06
  unclecode

  committed
  768aa06

• Update gitignore

  unclecode

  committed
  dbb587d

Commits on Oct 18, 2024

• Rename some flags name, introducing magic flag.

  unclecode

  committed
  dd17ed0

• Update requirements and switch to 0.3.8

  unclecode

  committed
  aab6ea0

• chore: Bump version to 0.3.71 and improve error handling

  Show description for b8147b6
  unclecode

  committed
  b8147b6

• Fix the model nam ein quick start example

  unclecode

  committed
  b309bc3

Commits on Oct 19, 2024

• [v0.3.71] Enhance chunking strategies and improve overall performance

  Show description for 4e2852d
  unclecode

  committed
  4e2852d

• Update Changelog

  unclecode

  committed
  e7cd8a1

Commits on Oct 20, 2024

• Enhance Markdown generation and external content control

  Show description for 6ec4cb3
  unclecode

  committed
  6ec4cb3

• Refactor content scrapping strategy and improve error handling

  unclecode

  committed
  1dd36f9

• Fix Base64 image parsing in WebScrappingStrategy (issue 182)

  Show description for 04d16e6
  unclecode

  committed
  04d16e6

Commits on Oct 21, 2024

• feat: customize crawl base directory

  IdrisHanafi

  committed
  a5f627b

Commits on Oct 22, 2024

• [v0.3.72] Enhance content extraction and proxy support

  Show description for 60ba131
  unclecode

  committed
  60ba131

Commits on Oct 24, 2024

• Merge pull request unclecode#194 from IdrisHanafi/feat/customize-crawl-base-directory

  Show description for 32f57c4
  unclecode

  authored
  32f57c4

• feat: enhance crawler with overlay removal and improved screenshot capabilities

  Show description for bcfe83f
  unclecode

  committed
  bcfe83f

• Update version

  unclecode

  committed
  38474bd

Commits on Oct 27, 2024

• Update Documentation

  unclecode

  committed
  4239654

• Merge branch 'main' of https://github.com/unclecode/crawl4ai

  unclecode

  committed
  ff9149b

• Update gitignore

  unclecode

  committed
  ac9d83c

• Merge branch '0.3.72'

  unclecode

  committed
  d61615e

• Update Docs folder, prepare branch for new version 0.3.73

  unclecode

  committed
  c2a71a5

Commits on Oct 28, 2024

• Update Readme

  unclecode

  committed
  d913e20

• Add badges to README

  unclecode

  committed
  b2800fe

• Fix README badge

  unclecode

  committed
  d9e0b7a

Commits on Oct 29, 2024

• Update new tutorial documents and added to the docs folder.

  unclecode

  committed
  3529c2e

• Merge branch '0.3.73'

  unclecode

  committed
  e9f7d5e

Commits on Oct 30, 2024

• build: make requirements more flexible

  Show description for df9ee44
  mjvankampen

  committed
  df9ee44

• fix dev requirements and lock playwright due to failing tests

  mjvankampen

  committed
  605a827

• Update documents, upload new version of quickstart.

  unclecode

  committed
  9307c19

• Merge branch '0.3.73'

  unclecode

  committed
  982d203

• Update README

  unclecode

  committed
  47464ce

• Update README

  unclecode

  committed
  cb6f532

• Update README: Fix typo in project name

  unclecode

  committed
  e97e8df

• Refactor tutorial markdown files: Update numbering and formatting

  unclecode

  committed
  19c3f3e

Commits on Oct 31, 2024

• chore(docs): fix documentation links + markdown lint

  timoa

  committed
  0a09d78

• Add mission.md file

  unclecode

  committed
  6c7235d

• Add link to mission statement in README

  unclecode

  committed
  d8eef02

• Add mission diagram to MISSION.md

  unclecode

  committed
  492ada0

• Refactor mission section in README and add mission diagram

  unclecode

  committed
  62a86db

Commits on Nov 3, 2024

• Merge pull request unclecode#218 from timoa/main

  Show description for 07f508b
  unclecode

  authored
  07f508b

• Merge pull request unclecode#215 from mjvankampen/build/flexible-requirements

  Show description for de6b43f
  unclecode

  authored
  de6b43f

Commits on Nov 4, 2024

• Improved database management and error handling, updated README instructions, refined .gitignore, enhanced async web crawling capabilities, and updated dependencies.

  unclecode

  committed
  54d5a3a

• Refactor .gitignore.dev file: Add ignore patterns for various files and directories

  unclecode

  committed
  e28c49a

• Merge branch '0.3.73' of https://github.com/unclecode/crawl4ai into 0.3.73

  unclecode

  committed
  42f1c67

• Update dev gitignore

  unclecode

  committed
  33d0e9e

• Update gitignore

  unclecode

  committed
  7b0cca4

• Update CHANGELOG

  unclecode

  committed
  fbdf870

• Merge branch '0.3.73' of https://github.com/unclecode/crawl4ai into 0.3.73

  unclecode

  committed
  be8f4fc

• Refactor version management and remove deprecated gitignore.dev file

  unclecode

  committed
  e6c914d

• Creating the API server component

  unclecode

  committed
  c4c6227

• Preventing NoneType has no attribute get Errors

  Show description for 0bba0e0
  bizrockman

  authored
  0bba0e0

• Rename episode_08_Media_Handling:_Images,_Videos,_and_Audio.md to episode_08_Media_Handling_Images_Videos_and_Audio.md

  Show description for a28046c
  bizrockman

  authored
  a28046c

• Rename episode_11_1_Extraction_Strategies:_JSON_CSS.md to episode_11_1_Extraction_Strategies_JSON_CSS.md

  Show description for 870296f
  bizrockman

  authored
  870296f

• Rename episode_11_2_Extraction_Strategies:_LLM.md to episode_11_2_Extraction_Strategies_LLM.md

  Show description for 3a3c88a
  bizrockman

  authored
  3a3c88a

• Rename episode_11_3_Extraction_Strategies:_Cosine.md to episode_11_3_Extraction_Strategies_Cosine.md

  Show description for 796dbaf
  bizrockman

  authored
  796dbaf

Commits on Nov 5, 2024

• feat(core): Release v0.3.73 with Browser Takeover and Docker Support

  Show description for 67a23c3
  unclecode

  committed
  67a23c3

• chore(version): bump version to 0.3.73

  unclecode

  committed
  3cf19a1

• Merge branch 'main' of https://github.com/unclecode/crawl4ai

  unclecode

  committed
  43a2b26

• docs(README): update Docker usage instructions and add deployment options

  unclecode

  committed
  1c20b81

• refactor(core): remove main_v0.py file and associated functionality

  unclecode

  committed
  2a54f3c

• docs(README): update release notes for version 0.3.73 with new features and improvements

  unclecode

  committed
  1e7db0d

• feat(api): add CORS support and static file serving, update root redirect

  unclecode

  committed
  b512636

Commits on Nov 6, 2024

• Merge pull request unclecode#229 from bizrockman/main

  Show description for c5aa1be
  unclecode

  authored
  c5aa1be

• Refactored the CustomHTML2Text class in content_scrapping_strategy.py to remove the handling logic for header tags (h1-h6), which are now commented out. This cleanup improves code readability a…

  Show description for 9f5eef1
  unclecode

  committed
  9f5eef1

• Update README.md

  devatnull

  authored
  2879344

Commits on Nov 7, 2024

• Update API server request object. text_docker file and Readme

  unclecode

  committed
  f757423

• Merge branch 'main' of https://github.com/unclecode/crawl4ai

  unclecode

  committed
  16f9186

• Fixed issues with the Manage Browser, including its inability to connect to the user directory and inability to create new pages within the Manage Browser context; all issues are now resolved.

  unclecode

  committed
  b120965

Commits on Nov 8, 2024

• Remove some old files.

  unclecode

  committed
  bcdd809

• Add Docker example script for testing Crawl4AI functionality

  unclecode

  committed
  f9a297e

Commits on Nov 9, 2024

• Update Roadmap

  unclecode

  committed
  a098483

Commits on Nov 12, 2024

• Enhance Async Crawler with Playwright support

  Show description for b6d6631
  unclecode

  committed
  b6d6631

• Merge pull request unclecode#234 from devatnull/patch-1

  Show description for 8c22396
  unclecode

  authored
  8c22396

• feat(config): Adding a configurable way of setting the cache directory for constrained environments

  

  Mahesh

  committed
  00026b5

Commits on Nov 13, 2024

• fix: Resolve unexpected BrowserContext closure during crawl in Docker

  Show description for bf91adf
  unclecode

  committed
  bf91adf

• Update change log

  unclecode

  committed
  61b93eb

• Merge pull request unclecode#255 from maheshpec/feature/configure-cache-directory

  Show description for 38044d4
  unclecode

  authored
  38044d4

• perf(crawler): major performance improvements & raw HTML support

  Show description for c38ac29
  unclecode

  committed
  c38ac29

• feat(crawler): support local files and raw HTML input in AsyncWebCrawler

  unclecode

  committed
  17913f5

Commits on Nov 14, 2024

• - In this commit, the library is updated to process file downloads. Users can now specify a download folder and trigger the download process via JavaScript or other means, with all files being save…

  Show description for 3d00fee
  unclecode

  committed
  3d00fee

• Update changelog

  unclecode

  committed
  7f1ae5a

Commits on Nov 15, 2024

• test(content_filter): add comprehensive tests for BM25ContentFilter functionality

  unclecode

  committed
  1f269f9

• chore: update .gitignore and enhance changelog with major feature additions and examples

  unclecode

  committed
  ae7ebc0

• Merge pull request #7 from aravindkarnam/main

  Show description for 60670b2
  aravindkarnam

  authored
  60670b2

Commits on Nov 16, 2024

• New async database manager and migration support

  Show description for d0014c6
  unclecode

  committed
  d0014c6

• refactor: migrate versioning to __version__.py and remove deprecated _version.py

  unclecode

  committed
  5098442

• feat(crawl_sync): add synchronous crawl endpoint and corresponding test

  unclecode

  committed
  90df692

• feat(deploy): add Railway deployment configuration and setup instructions

  unclecode

  committed
  e62c807

• feat(deploy): add deployment configuration and templates for crawl4ai

  unclecode

  committed
  f77f06a

• feat(docker): add MkDocs installation and build step for documentation

  unclecode

  committed
  fca1319

• feat(deploy): update instance size to professional-xs and add memory utilization alert

  unclecode

  committed
  6f2fe59

• feat(deploy): update branch to 0.3.74 and change instance size to basic-xs

  unclecode

  committed
  6b569cc

• feat(deploy): update instance size to professional-xs and add memory utilization alert parameters

  unclecode

  committed
  67edc2d

• feat(deploy): change instance size to professional-xs and update memory utilization alert window to 300 seconds

  unclecode

  committed
  5d0b132

• refactor(deploy): remove memory utilization alert configuration from deployment template

  unclecode

  committed
  79feab8

• refactor(docker): remove shared memory size configuration to streamline Dockerfile

  unclecode

  committed
  1961adb

• feat(api): add API token authentication and update Dockerfile description

  unclecode

  committed
  6360d05

• feat(docker): update Dockerfile for improved installation process and enhance deployment documentation with Docker Compose setup and API token security

  unclecode

  committed
  9139ef3

• feat(docs): enhance deployment documentation with one-click setup, API security details, and Docker Compose examples

  unclecode

  committed
  4b45b28

Commits on Nov 17, 2024

• feat(cache): introduce CacheMode and CacheContext for enhanced caching behavior

  Show description for 3a66aa8
  unclecode

  committed
  3a66aa8

• fix(docs): remove unnecessary blank line in README for improved readability

  unclecode

  committed
  3a524a3

• feat(crawl): implement direct crawl functionality and introduce CacheMode for improved caching control

  unclecode

  committed
  2a82455

• feat(database): implement version management and migration checks during initialization

  unclecode

  committed
  f9fe6f8

• Update changelog for 0.3.74

  unclecode

  committed
  a59c107

• feat(docs): update examples and documentation to replace bypass_cache with cache_mode for improved clarity

  unclecode

  committed
  df63a40

• feat(docs): update README for version 0.3.74 with new features and improvements

  Show description for 152ac35
  unclecode

  committed
  152ac35

Commits on Nov 18, 2024

• feat(docker): add Docker Compose configurations for local and hub deployment; enhance GPU support checks in Dockerfile

  Show description for 852729f
  unclecode

  committed
  852729f

• Merge remote-tracking branch 'origin/main' into 0.3.74

  unclecode

  committed
  b6af94c

Commits on Nov 19, 2024

• chore: update .gitignore to include manage-collab.sh

  unclecode

  committed
  73658c7

• test: trying to push to main

  

  ntohidikplay

  committed
  593c7ad

• test1: trying to push to main

  

  ntohidikplay

  committed
  3aae30e

• Update .gitignore to include .gitboss/ and todo_executor.md

  unclecode

  committed
  2f19d38

• Merge branch 'main' of https://github.com/unclecode/crawl4ai

  unclecode

  committed
  788c67c

• Remove test files

  unclecode

  committed
  fbcff85

• test: trying to push to 0.3.74

  

  ntohidikplay

  committed
  a6dad3f

• Delete test3.txt

  unclecode

  authored
  f2cb7d5

• Update .gitignore to exclude additional scripts and files

  unclecode

  committed
  b654c49

• chore: add manage-collab.sh to .gitignore

  unclecode

  committed
  2bdec1f

• Merge branch '0.3.74' of https://github.com/unclecode/crawl4ai into 0.3.74

  unclecode

  committed
  7047422

Commits on Nov 20, 2024

• Fix unclecode#260 prevent pass duplicated kwargs to scrapping_strategy (unclecode#269)

  Show description for d418a04
  darwing1210

  authored
  d418a04

• fix: crawler strategy exception handling and fixes (unclecode#271)

  NanmiCoder

  authored
  3439f78

Commits on Nov 21, 2024

• In this commit, we introduce the new concept of MakrdownGenerationStrategy, which allows us to expand our future strategies to generate better markdown. Right now, we generate raw markdown as we we…

  Show description for dbb751c
  unclecode

  committed
  dbb751c

Commits on Nov 22, 2024

• feat: enhance image processing capabilities

  Show description for 006bee4
  unclecode

  committed
  006bee4

• Update Redme

  unclecode

  committed
  571dda6

• feat: enhance Markdown generation to include fit_html attribute

  unclecode

  committed
  24ad2fe

• chore: update README to reflect new features and improvements in version 0.3.74

  unclecode

  committed
  e02935d

• chore: update README to include new features and improvements for version 0.3.74

  unclecode

  committed
  8dea3f4

• Merge branch '0.3.74'

  unclecode

  committed
  a5decaa

• Merge branch 'main' of https://github.com/unclecode/crawl4ai

  unclecode

  committed
  d7a112f

• feat: add enhanced markdown generation example with citations and file output

  unclecode

  committed
  0d0cef3

Commits on Nov 23, 2024

• Fixed a few bugs, import errors and changed to asyncio wait_for instead of timeout to support python versions < 3.11

  aravindkarnam

  committed
  c179703

• Fixed a bug in _process_links, handled condition for when url_scorer is passed as None, renamed the scrapper folder to scraper.

  aravindkarnam

  committed
  f8e85b1

• Merge pull request #8 from aravindkarnam/main

  Show description for 3d52b55
  aravindkarnam

  authored
  3d52b55

• fix: Exempting the start_url from can_process_url

  aravindkarnam

  committed
  2226ef5

• refactor: Add group ID to for images extracted from srcset.

  unclecode

  committed
  d729aa7

• feat: update version to 0.3.741 and enhance content filtering with heuristic strategy. Fixing the issue that when the past HTML to BM25 content filter does not have any HTML elements.

  unclecode

  committed
  829a1f7

Commits on Nov 24, 2024

• chore: remove Railway deployment configuration and related documentation

  unclecode

  committed
  edad7b6

• feat: add support for arm64 platform in Docker commands and update INSTALL_TYPE variable in docker-compose

  unclecode

  committed
  d7c5b90

• feat: update version to 0.3.742

  unclecode

  committed
  de43505

• chore: remove deprecated Docker Compose configurations for crawl4ai service

  unclecode

  committed
  b09a86c

• chore: remove deprecated Docker Compose configurations for crawl4ai service

  unclecode

  committed
  195c0cc

Commits on Nov 26, 2024

• chore: 1. Expose process_external_links as a param

  Show description for b13fd71
  aravindkarnam

  committed
  b13fd71

• fix: moved depth as a param to can_process_url and applying filter chain only when depth is not zero. This way

  Show description for ee3001b
  aravindkarnam

  committed
  ee3001b

• Remove the can_process_url check from _process_links since it's already being checked in process_url

  aravindkarnam

  committed
  a98d51a

• Fix "Future attached to a different loop" error by ensuring tasks are created in the correct event loop

  Show description for a888c91
  aravindkarnam

  committed
  a888c91

• <Future pending> issue fix was incorrect. Reverting

  aravindkarnam

  committed
  155c756

• fixed the final scraper_quickstart.py example

  aravindkarnam

  committed
  9530ded

• fixed the final scraper_quickstart.py example

  aravindkarnam

  committed
  ff731e4

• updated definition of can_process_url to include dept as an argument, as it's needed to skip filters for start_url

  aravindkarnam

  committed
  2f5e059

Commits on Nov 27, 2024

• docs: update CONTRIBUTORS.md to acknowledge aadityakanjolia4 for fixing 'CustomHTML2Text' bug

  unclecode

  committed
  c6a0221

• Merge branch 'main' of https://github.com/unclecode/crawl4ai

  unclecode

  committed
  b5d4db0

• docs: enhance development installation instructions (unclecode#286)

  Show description for 73661f7
  nelzomal

  authored
  73661f7

• Fix: handled the cases where markdown_with_citations, references_markdown, and filtered_html might not be defined. (unclecode#293)

  Show description for f998e9e
  HamzaFarhan

  authored
  f998e9e

Commits on Nov 28, 2024

• Enhance features and documentation

  Show description for 24723b2
  unclecode

  committed
  24723b2

• Merge branch 'next' of https://github.com/unclecode/crawl4ai into next

  unclecode

  committed
  a1c7dc1

• feat: update changelog for version 0.3.743 with new features, improvements, and contributor acknowledgments

  unclecode

  committed
  3ff0b0b

• Merge branch 'main' into 0.3.743

  unclecode

  committed
  76bea6c

• fix: resolve merge conflict in DefaultMarkdownGenerator affecting fit_markdown generation

  unclecode

  committed
  c2d4784

• docs: update README for version 0.3.743 with new features, enhancements, and contributor acknowledgments

  unclecode

  committed
  e4acd18

• docs: update README for version 0.3.743 with new features, enhancements, and contributor acknowledgments

  unclecode

  committed
  ce7d494

• docs: update README to keep details open for extraction capabilities, browser integration, input/output flexibility, utility & debugging, security & accessibility, community & documentation, and cu…

  Show description for d556dad
  unclecode

  committed
  d556dad

• docs: update README for version 0.3.743 with improved formatting and contributor acknowledgments

  unclecode

  committed
  3abb573

• refactor: update cache handling in quickstart_async example to use CacheMode enum

  unclecode

  committed
  d583aa4

• fix: correct typo in function documentation for clarity and accuracy

  unclecode

  committed
  a69f7a9

• docs: update README to reflect new branding and improve section headings for clarity

  unclecode

  committed
  ddfb670

• docs: refine README content for clarity and conciseness, improving descriptions and formatting

  unclecode

  committed
  3fda66b

• docs: enhance README with development TODOs and refine mission statement for clarity

  unclecode

  committed
  efe93a5

• Merge branch 'next' - Update README, and quickstart examples

  unclecode

  committed
  0cbd594

• docs: update quickstart_async.py to enable example function calls for better demonstration

  unclecode

  committed
  0bccf23

• feat: implement create_box_message utility for formatted error messages and enhance error logging in AsyncWebCrawler

  unclecode

  committed
  a036b7f

• chore: update version to 0.3.744 and add publish.sh to .gitignore

  unclecode

  committed
  a9b6b65

• docs: fix link formatting for recent updates section in README

  unclecode

  committed
  b14e83f

• docs: fix link formatting for recent updates section in README

  unclecode

  committed
  776efa7

• docs: fix link formatting for recent updates section in README

  unclecode

  committed
  48d43c1

• docs: fix link formatting for recent updates section in README

  unclecode

  committed
  9221c08

• CRAWL4_AI_BASE_DIRECTORY should be Path object instead of string (unclecode#298)

  Show description for cf35cbe
  paulokuong

  authored
  cf35cbe

• Enhance setup process and update contributors list

  Show description for 1d83c49
  unclecode

  committed
  1d83c49

• chore: update version to 0.3.745

  unclecode

  committed
  652d396

• fix: improve handling of CRAWL4_AI_BASE_DIRECTORY environment variable in setup.py

  unclecode

  committed
  7d81c17

• Merge branch 'next'

  unclecode

  committed
  98c64f9

• Merge branch 'main' of https://github.com/unclecode/crawl4ai

  unclecode

  committed
  aa3e2d0

• docs: update README to reflect latest version v0.3.745

  unclecode

  committed
  c848577

• fix: update package versions in requirements.txt for compatibility

  unclecode

  committed
  c0e87ab

• Update README.md (unclecode#300)

  unclecode

  authored
  b0419ed

Commits on Nov 29, 2024

• Migrating from the classic setup.py to a using PyProject approach.

  unclecode

  committed
  449dd7c

• refactor: remove legacy build hooks and setup files, migrate to setup.cfg and pyproject.toml

  unclecode

  committed
  12e73d4

• Enhance installation and migration processes

  Show description for d202f35
  unclecode

  committed
  d202f35

• Refactor Dockerfile and clean up main.py

  Show description for 93bf3e8
  unclecode

  committed
  93bf3e8

• Enhance Docker support and improve installation process

  Show description for f9c98a3
  unclecode

  committed
  f9c98a3

• docs: update Raspberry Pi section to indicate upcoming support

  unclecode

  committed
  1def53b

• Merge branch 'next'

  unclecode

  committed
  569bdb6

• 🩹 Page-evaluate navigation destroyed error (unclecode#304)

  Show description for 1ed7c15
  dvschuyl

  authored
  1ed7c15

• fix: handle errors during image dimension updates in AsyncPlaywrightCrawlerStrategy

  unclecode

  committed
  0780db5

• docs: add contributor entry for dvschuyl regarding AsyncPlaywrightCrawlerStrategy issue

  unclecode

  committed
  8c76a8c

Commits on Nov 30, 2024

• Enhance User-Agent Handling

  Show description for 3e83893
  unclecode

  committed
  3e83893

• bump version to 0.3.747

  unclecode

  committed
  80d58ad

Commits on Dec 1, 2024

• Add PruningContentFilter with unit tests and update documentation

  Show description for 293f299
  unclecode

  committed
  293f299

Commits on Dec 2, 2024

• fix: pass logger to WebScrapingStrategy and update score computation in PruningContentFilter

  unclecode

  committed
  95a4f74

Commits on Dec 3, 2024

• refactor: improve error handling in DataProcessor and optimize data parsing logic

  unclecode

  committed
  e9639ad

• docs: update README and blog for version 0.4.0 release, highlighting new features and improvements

  unclecode

  committed
  b02544b

Commits on Dec 4, 2024

• Updated to version 0.4.0 with new features

  Show description for 486db3a
  unclecode

  committed
  486db3a

• Merge branch 'next'

  unclecode

  committed
  56f82f3

• Merge issues with 0.4.0 is over

  unclecode

  committed
  a45b8b1

Commits on Dec 5, 2024

• Refactored web scraping components

  Show description for 8c611dc
  unclecode

  committed
  8c611dc

Commits on Dec 8, 2024

• feat: Enhance AsyncPlaywrightCrawlerStrategy with text-only and light modes, dynamic viewport adjustment, and session management

  Show description for c51e901
  unclecode

  committed
  c51e901

• Merge branch 'next'

  unclecode

  committed
  740214e

Commits on Dec 9, 2024

• fixing Readmen tap (unclecode#313)

  olavohenrique03

  authored
  e3488da

• fix: The extract method logs output only when self.verbose is set to True. (unclecode#314)

  Show description for ba3e808
  

  lu4nx

  and

  lu4nx

  authored
  ba3e808

• Commit Message:

  Show description for 2d31915
  unclecode

  committed
  2d31915

• Fixed typo (unclecode#324)

  moamamun

  authored
  ded554d

Commits on Dec 10, 2024

• Implement new async crawler features and stability updates

  Show description for e130fd8
  unclecode

  committed
  e130fd8

• Add PDF & screenshot functionality, new tutorial

  Show description for 5431fa2
  unclecode

  committed
  5431fa2

• Update async_webcrawler.py (unclecode#337)

  Show description for 7591648
  lvzhengri

  authored
  7591648

• Add full-page screenshot and PDF export features

  Show description for 5188b7a
  unclecode

  committed
  5188b7a

Commits on Dec 12, 2024

• Enhance AsyncWebCrawler and related configurations

  Show description for 0982c63
  unclecode

  committed
  0982c63

• Bump version to 0.4.2

  unclecode

  committed
  de1766d

• chore: Update .gitignore to include new files and directories

  unclecode

  committed
  3d69715

• Merge branch 'main' of https://github.com/unclecode/crawl4ai

  unclecode

  committed
  20d6f5f

• Add release notes and documentation for version 0.4.2: Configurable Crawlers, Session Management, and Enhanced Screenshot/PDF features

  unclecode

  committed
  4a72c5e

• Merge branch 'next'

  unclecode

  committed
  399af80

• Update README for version 0.4.2: Reflect new features and enhancements

  unclecode

  committed
  7af1d32

Commits on Dec 13, 2024

• Feature: Add Markdown generation to CrawlerRunConfig

  Show description for 7524aa7
  unclecode

  committed
  7524aa7

Commits on Dec 15, 2024

• Fix js_snipprt issue 0.4.21

  Show description for e9e5b56
  unclecode

  committed
  e9e5b56

• Bump version to 0.4.22

  unclecode

  committed
  ed7bc19

Commits on Dec 17, 2024

• Merge pull request #9 from aravindkarnam/main

  Show description for 7c0fa26
  aravindkarnam

  authored
  7c0fa26

Commits on Dec 18, 2024

• fix: Added browser config and crawler run config from 0.4.22

  aravindkarnam

  committed
  7a5f83b