Python Automation

  1. Web Automation and Scraping
    1. Fundamentals of Web Technologies
      1. Basic HTML Structure
        1. HTML Elements and Tags
          1. Attributes
            1. Document Object Model
              1. Common HTML Elements
              2. CSS Selectors
                1. Element Selectors
                  1. Class Selectors
                    1. ID Selectors
                      1. Attribute Selectors
                        1. Descendant Selectors
                          1. Pseudo-selectors
                          2. Understanding HTTP
                            1. HTTP Methods
                              1. GET Requests
                                1. POST Requests
                                  1. PUT Requests
                                    1. DELETE Requests
                                    2. HTTP Status Codes
                                      1. Request Headers
                                        1. Response Headers
                                          1. Cookies and Sessions
                                        2. Ethical Considerations and Best Practices
                                          1. Understanding robots.txt
                                            1. Respecting Rate Limits
                                              1. User-Agent Headers
                                                1. Avoiding Server Overload
                                                  1. Privacy and Data Protection
                                                    1. Terms of Service Compliance
                                                    2. Making Web Requests with requests
                                                      1. Installing the requests Library
                                                        1. Basic GET Requests
                                                          1. Basic POST Requests
                                                            1. Handling Request Parameters
                                                              1. Working with Headers
                                                                1. Managing Cookies
                                                                  1. Session Objects
                                                                    1. Handling Redirects
                                                                      1. Setting Timeouts
                                                                        1. SSL Verification
                                                                          1. Proxy Support
                                                                            1. Error Handling in Requests
                                                                              1. Response Object Methods
                                                                              2. Parsing HTML with BeautifulSoup
                                                                                1. Installing BeautifulSoup
                                                                                  1. Creating Soup Objects
                                                                                    1. Parsing HTML Content
                                                                                      1. Finding Elements
                                                                                        1. find Method
                                                                                          1. find_all Method
                                                                                            1. CSS Selectors with select
                                                                                            2. Extracting Data
                                                                                              1. Text Content
                                                                                                1. Attribute Values
                                                                                                  1. HTML Content
                                                                                                  2. Modifying HTML
                                                                                                    1. Handling Different Parsers
                                                                                                      1. Encoding Issues
                                                                                                      2. Browser Automation with Selenium
                                                                                                        1. Understanding Browser Automation
                                                                                                          1. Installing Selenium
                                                                                                            1. WebDriver Setup
                                                                                                              1. Chrome WebDriver
                                                                                                                1. Firefox WebDriver
                                                                                                                  1. Edge WebDriver
                                                                                                                  2. Basic Browser Control
                                                                                                                    1. Opening Browsers
                                                                                                                      1. Closing Browsers
                                                                                                                      2. Locating Web Elements
                                                                                                                        1. By ID
                                                                                                                          1. By Name
                                                                                                                            1. By Class Name
                                                                                                                              1. By Tag Name
                                                                                                                                1. By CSS Selector
                                                                                                                                  1. By XPath
                                                                                                                                    1. By Link Text
                                                                                                                                    2. Interacting with Elements
                                                                                                                                      1. Clicking Elements
                                                                                                                                        1. Sending Text Input
                                                                                                                                          1. Clearing Input Fields
                                                                                                                                            1. Submitting Forms
                                                                                                                                              1. Selecting from Dropdowns
                                                                                                                                                1. Handling Checkboxes and Radio Buttons
                                                                                                                                                2. Handling Dynamic Content
                                                                                                                                                  1. Implicit Waits
                                                                                                                                                    1. Explicit Waits
                                                                                                                                                      1. Expected Conditions
                                                                                                                                                        1. Custom Wait Conditions
                                                                                                                                                        2. Advanced Browser Operations
                                                                                                                                                          1. Executing JavaScript
                                                                                                                                                            1. Taking Screenshots
                                                                                                                                                              1. Managing Windows and Tabs
                                                                                                                                                                1. Handling Alerts and Pop-ups
                                                                                                                                                                  1. File Upload and Download
                                                                                                                                                                  2. Headless Browser Mode
                                                                                                                                                                    1. Browser Options and Preferences

                                                                                                                                                                  Previous

                                                                                                                                                                  4. Working with Common Data Formats

                                                                                                                                                                  Go to top

                                                                                                                                                                  Next

                                                                                                                                                                  6. Interacting with APIs