• For Individuals
  • For Businesses
  • For Universities
  • For Governments
Coursera
  • Log In
  • Join for Free
    Coursera
    • Browse
    • Web Crawler

    Web Crawler Courses Online

    Learn to build web crawlers for data extraction. Understand how to collect and analyze web data using automated scripts.

    Skip to search results

    Filter by

    Subject
    Required
     *

    Language
    Required
     *

    The language used throughout the course, in both instruction and assessments.

    Learning Product
    Required
     *

    Build job-relevant skills in under 2 hours with hands-on tutorials.
    Learn from top instructors with graded assignments, videos, and discussion forums.
    Learn a new tool or skill in an interactive, hands-on environment.
    Get in-depth knowledge of a subject by completing a series of courses and projects.
    Earn career credentials from industry leaders that demonstrate your expertise.
    Earn career credentials while taking courses that count towards your Master’s degree.
    Earn your Bachelor’s or Master’s degree online for a fraction of the cost of in-person learning.
    Earn a university-issued career credential in a flexible, interactive format.

    Level
    Required
     *

    Duration
    Required
     *

    Skills
    Required
     *

    Subtitles
    Required
     *

    Educator
    Required
     *

    Explore the Web Crawler Course Catalog

    • P

      Packt

      Web Scraping Tutorial with Scrapy and Python for Beginners

      Skills you'll gain: Web Scraping, Data Import/Export, Extensible Markup Language (XML), Data Processing, Selenium (Software), Cascading Style Sheets (CSS), JSON, MongoDB, Restful API, Data Storage

      Beginner · Course · 3 - 6 Months

    • Status: Preview
      Preview
      I

      Institut Mines-Télécom

      Cybersécurité : comment sécuriser un site web

      Skills you'll gain: Threat Modeling, Cyber Risk, Open Web Application Security Project (OWASP), Cybersecurity, Cyber Attacks, Application Security, Security Testing, Vulnerability Assessments, Secure Coding, SQL

      Intermediate · Course · 1 - 3 Months

    • P

      Packt

      Burp Suite Unfiltered - Go from a Beginner to Advanced

      Skills you'll gain: Exploit development, Test Tools, Cyber Security Assessment, Vulnerability Scanning, Vulnerability Assessments, Web Development Tools, Application Security, Web Servers, Network Protocols, Web Applications, Proxy Servers, Automation

      Beginner · Course · 1 - 3 Months

    • Status: Preview
      Preview
      C

      Coursera Instructor Network

      AJAX for Web Developers

      Skills you'll gain: Ajax, JSON, JavaScript Frameworks, Javascript, Application Programming Interface (API), Restful API, Web Applications, Real Time Data, Application Security

      4.8
      Rating, 4.8 out of 5 stars
      ·
      8 reviews

      Intermediate · Course · 1 - 4 Weeks

    • Status: Free Trial
      Free Trial
      B

      Board Infinity

      Build a Webpage with HTML and CSS

      Skills you'll gain: Cascading Style Sheets (CSS), Web Design and Development, User Interface and User Experience (UI/UX) Design, Web Content Accessibility Guidelines

      4.4
      Rating, 4.4 out of 5 stars
      ·
      21 reviews

      Beginner · Course · 1 - 4 Weeks

    • Status: New
      New
      Status: Preview
      Preview
      S

      Simplilearn

      Selenium Course for Beginners

      Skills you'll gain: Test Automation, Software Testing, Scripting, Automation, Regression Testing, Web Development Tools, Browser Compatibility, Test Case, Scalability

      Beginner · Course · 1 - 4 Weeks

    • P

      Packt

      Playwright Python and Pytest for Web Automation Testing

      Skills you'll gain: Continuous Integration, Test Automation, Authentications, Software Testing, Unit Testing, Behavior-Driven Development, Application Programming Interface (API), Browser Compatibility, Test Case, GitHub, User Interface (UI), Debugging

      4
      Rating, 4 out of 5 stars
      ·
      13 reviews

      Intermediate · Course · 3 - 6 Months

    • Status: Free Trial
      Free Trial
      J

      Johns Hopkins University

      HTML, CSS, and Javascript for Web Developers

      Skills you'll gain: Cascading Style Sheets (CSS), HTML and CSS, Javascript, Ajax, Responsive Web Design, Bootstrap (Front-End Framework), Front-End Web Development, Web Design, Hypertext Markup Language (HTML), Browser Compatibility, Web Design and Development, Web Development, JSON, Web Applications, Scripting, Usability, Cross Platform Development, Object Oriented Programming (OOP), Event-Driven Programming, User Interface and User Experience (UI/UX) Design

      4.7
      Rating, 4.7 out of 5 stars
      ·
      17K reviews

      Beginner · Specialization · 1 - 3 Months

    • Status: Free Trial
      Free Trial
      S

      Scrimba

      Learn HTML and CSS

      Skills you'll gain: HTML and CSS, Hypertext Markup Language (HTML), Responsive Web Design, Cascading Style Sheets (CSS), Web Development Tools, Application Deployment, Web Design and Development, Software Development Tools, Web Development, Front-End Web Development, Interactive Design, User Interface (UI) Design, GitHub

      4.6
      Rating, 4.6 out of 5 stars
      ·
      114 reviews

      Beginner · Course · 3 - 6 Months

    • P

      Packt

      Hands-On Web App Pentesting

      Skills you'll gain: Penetration Testing, Open Web Application Security Project (OWASP), Web Applications, Vulnerability Scanning, Exploitation techniques, Vulnerability Assessments, Cyber Security Assessment, Application Security, Web Servers, Content Management Systems, Application Programming Interface (API), Databases

      Intermediate · Course · 1 - 4 Weeks

    • Status: New
      New
      Status: Free Trial
      Free Trial
      B

      Board Infinity

      Semantic HTML & Accessibility

      Skills you'll gain: Web Content Accessibility Guidelines, Hypertext Markup Language (HTML), Web Analytics and SEO, Web Design and Development, Semantic Web, Performance Tuning, Browser Compatibility, Web Applications, Web Development, UI Components, Web Content, Responsive Web Design, Cascading Style Sheets (CSS), Javascript

      Intermediate · Course · 1 - 4 Weeks

    • Status: Free Trial
      Free Trial
      U

      University of California, Davis

      Introduction to Google SEO

      Skills you'll gain: Persona Development, Search Engine Optimization, Web Analytics and SEO, Target Audience, Keyword Research, Google Analytics, Digital Marketing, User Research, Content Strategy, Web Content, Content Performance Analysis, Data Analysis, Algorithms, Business Reporting

      4.6
      Rating, 4.6 out of 5 stars
      ·
      10K reviews

      Beginner · Course · 1 - 4 Weeks

    1234…300

    In summary, here are 10 of our most popular web crawler courses

    • Web Scraping Tutorial with Scrapy and Python for Beginners: Packt
    • Cybersécurité : comment sécuriser un site web: Institut Mines-Télécom
    • Burp Suite Unfiltered - Go from a Beginner to Advanced: Packt
    • AJAX for Web Developers: Coursera Instructor Network
    • Build a Webpage with HTML and CSS: Board Infinity
    • Selenium Course for Beginners: Simplilearn
    • Playwright Python and Pytest for Web Automation Testing: Packt
    • HTML, CSS, and Javascript for Web Developers: Johns Hopkins University
    • Learn HTML and CSS: Scrimba
    • Hands-On Web App Pentesting: Packt

    Skills you can learn in Software Development

    Programming Language (34)
    Google (25)
    Computer Program (21)
    Software Testing (21)
    Web (19)
    Google Cloud Platform (18)
    Application Programming Interfaces (17)
    Data Structure (16)
    Problem Solving (14)
    Object-oriented Programming (13)
    Kubernetes (10)
    List & Label (10)

    Other topics to explore

    Arts and Humanities
    338 courses
    Business
    1095 courses
    Computer Science
    668 courses
    Data Science
    425 courses
    Information Technology
    145 courses
    Health
    471 courses
    Math and Logic
    70 courses
    Personal Development
    137 courses
    Physical Science and Engineering
    413 courses
    Social Sciences
    401 courses
    Language Learning
    150 courses

    Coursera Footer

    Skills

    • Artificial Intelligence (AI)
    • Cybersecurity
    • Data Analytics
    • Digital Marketing
    • English Speaking
    • Generative AI (GenAI)
    • Microsoft Excel
    • Microsoft Power BI
    • Project Management
    • Python

    Certificates & Programs

    • Google Cybersecurity Certificate
    • Google Data Analytics Certificate
    • Google IT Support Certificate
    • Google Project Management Certificate
    • Google UX Design Certificate
    • IBM Data Analyst Certificate
    • IBM Data Science Certificate
    • Machine Learning Certificate
    • Microsoft Power BI Data Analyst Certificate
    • UI / UX Design Certificate

    Industries & Careers

    • Business
    • Computer Science
    • Data Science
    • Education & Teaching
    • Engineering
    • Finance
    • Healthcare
    • Human Resources (HR)
    • Information Technology (IT)
    • Marketing

    Career Resources

    • Career Aptitude Test
    • Examples of Strengths and Weaknesses for Job Interviews
    • High-Income Skills to Learn
    • How Does Cryptocurrency Work?
    • How to Highlight Duplicates in Google Sheets
    • How to Learn Artificial Intelligence
    • Popular Cybersecurity Certifications
    • Preparing for the PMP Certification
    • Signs You Will Get the Job After an Interview
    • What Is Artificial Intelligence?

    Coursera

    • About
    • What We Offer
    • Leadership
    • Careers
    • Catalog
    • Coursera Plus
    • Professional Certificates
    • MasterTrack® Certificates
    • Degrees
    • For Enterprise
    • For Government
    • For Campus
    • Become a Partner
    • Social Impact
    • Free Courses
    • Share your Coursera learning story

    Community

    • Learners
    • Partners
    • Beta Testers
    • Blog
    • The Coursera Podcast
    • Tech Blog

    More

    • Press
    • Investors
    • Terms
    • Privacy
    • Help
    • Accessibility
    • Contact
    • Articles
    • Directory
    • Affiliates
    • Modern Slavery Statement
    • Manage Cookie Preferences
    Learn Anywhere
    Download on the App Store
    Get it on Google Play
    Logo of Certified B Corporation
    © 2025 Coursera Inc. All rights reserved.
    • Coursera Facebook
    • Coursera Linkedin
    • Coursera Twitter
    • Coursera YouTube
    • Coursera Instagram
    • Coursera TikTok