Data Science

  1. Data Acquisition and Management
    1. Data Sources
      1. Internal Data Sources
        1. Transactional Systems
          1. Customer Relationship Management Systems
            1. Enterprise Resource Planning Systems
              1. Log Files
              2. External Data Sources
                1. Public Datasets
                  1. Commercial Data Providers
                    1. Government Data
                      1. Social Media Data
                        1. Web Data
                        2. Real-time Data Sources
                          1. Streaming Data
                            1. IoT Sensors
                              1. API Feeds
                            2. Data Collection Methods
                              1. Surveys and Questionnaires
                                1. Design Principles
                                  1. Sampling Methods
                                    1. Response Bias
                                    2. Observational Studies
                                      1. Structured Observation
                                        1. Unstructured Observation
                                          1. Ethical Considerations
                                          2. Experiments
                                            1. Controlled Experiments
                                              1. Natural Experiments
                                                1. Quasi-experiments
                                                2. Web Scraping
                                                  1. HTML Parsing
                                                    1. CSS Selectors
                                                      1. XPath
                                                        1. JavaScript Rendering
                                                          1. Rate Limiting
                                                            1. Tools and Libraries
                                                              1. BeautifulSoup
                                                                1. Scrapy
                                                                  1. Selenium
                                                                2. APIs
                                                                  1. REST APIs
                                                                    1. GraphQL APIs
                                                                      1. Authentication Methods
                                                                        1. Rate Limiting
                                                                          1. Error Handling
                                                                            1. API Documentation
                                                                          2. File Formats and Data Storage
                                                                            1. Structured Data Formats
                                                                              1. CSV
                                                                                1. TSV
                                                                                  1. Excel
                                                                                    1. JSON
                                                                                      1. XML
                                                                                        1. Parquet
                                                                                          1. Avro
                                                                                            1. ORC
                                                                                            2. Unstructured Data Formats
                                                                                              1. Text Files
                                                                                                1. Images
                                                                                                  1. Audio
                                                                                                    1. Video
                                                                                                    2. Database Systems
                                                                                                      1. Relational Databases
                                                                                                        1. MySQL
                                                                                                          1. PostgreSQL
                                                                                                            1. SQLite
                                                                                                              1. Oracle
                                                                                                                1. SQL Server
                                                                                                                2. NoSQL Databases
                                                                                                                  1. Document Stores
                                                                                                                    1. MongoDB
                                                                                                                      1. CouchDB
                                                                                                                      2. Key-Value Stores
                                                                                                                        1. Redis
                                                                                                                          1. DynamoDB
                                                                                                                          2. Column-Family
                                                                                                                            1. Cassandra
                                                                                                                              1. HBase
                                                                                                                              2. Graph Databases
                                                                                                                                1. Neo4j
                                                                                                                                  1. Amazon Neptune
                                                                                                                            2. Data Quality Assessment
                                                                                                                              1. Data Quality Dimensions
                                                                                                                                1. Accuracy
                                                                                                                                  1. Completeness
                                                                                                                                    1. Consistency
                                                                                                                                      1. Timeliness
                                                                                                                                        1. Validity
                                                                                                                                          1. Uniqueness
                                                                                                                                          2. Data Profiling
                                                                                                                                            1. Statistical Summaries
                                                                                                                                              1. Pattern Analysis
                                                                                                                                                1. Relationship Discovery
                                                                                                                                                  1. Anomaly Detection
                                                                                                                                                  2. Data Quality Metrics
                                                                                                                                                    1. Missing Value Rates
                                                                                                                                                      1. Duplicate Rates
                                                                                                                                                        1. Outlier Detection
                                                                                                                                                          1. Format Consistency
                                                                                                                                                        2. Data Cleaning and Preprocessing
                                                                                                                                                          1. Handling Missing Values
                                                                                                                                                            1. Missing Data Mechanisms
                                                                                                                                                              1. Missing Completely at Random
                                                                                                                                                                1. Missing at Random
                                                                                                                                                                  1. Missing Not at Random
                                                                                                                                                                  2. Imputation Techniques
                                                                                                                                                                    1. Mean Imputation
                                                                                                                                                                      1. Median Imputation
                                                                                                                                                                        1. Mode Imputation
                                                                                                                                                                          1. Forward Fill
                                                                                                                                                                            1. Backward Fill
                                                                                                                                                                              1. Interpolation
                                                                                                                                                                                1. Predictive Imputation
                                                                                                                                                                                2. Deletion Strategies
                                                                                                                                                                                  1. Listwise Deletion
                                                                                                                                                                                    1. Pairwise Deletion
                                                                                                                                                                                  2. Outlier Detection and Treatment
                                                                                                                                                                                    1. Statistical Methods
                                                                                                                                                                                      1. Z-score Method
                                                                                                                                                                                        1. IQR Method
                                                                                                                                                                                          1. Modified Z-score
                                                                                                                                                                                          2. Visualization Methods
                                                                                                                                                                                            1. Box Plots
                                                                                                                                                                                              1. Scatter Plots
                                                                                                                                                                                                1. Histograms
                                                                                                                                                                                                2. Machine Learning Methods
                                                                                                                                                                                                  1. Isolation Forest
                                                                                                                                                                                                    1. Local Outlier Factor
                                                                                                                                                                                                      1. One-Class SVM
                                                                                                                                                                                                      2. Treatment Strategies
                                                                                                                                                                                                        1. Removal
                                                                                                                                                                                                          1. Transformation
                                                                                                                                                                                                            1. Capping
                                                                                                                                                                                                              1. Binning
                                                                                                                                                                                                            2. Data Type Conversion
                                                                                                                                                                                                              1. Numeric Conversions
                                                                                                                                                                                                                1. String Conversions
                                                                                                                                                                                                                  1. Date and Time Conversions
                                                                                                                                                                                                                    1. Boolean Conversions
                                                                                                                                                                                                                    2. Text Data Cleaning
                                                                                                                                                                                                                      1. Case Normalization
                                                                                                                                                                                                                        1. Whitespace Removal
                                                                                                                                                                                                                          1. Special Character Handling
                                                                                                                                                                                                                            1. Encoding Issues
                                                                                                                                                                                                                            2. Duplicate Detection and Removal
                                                                                                                                                                                                                              1. Exact Duplicates
                                                                                                                                                                                                                                1. Fuzzy Duplicates
                                                                                                                                                                                                                                  1. Record Linkage
                                                                                                                                                                                                                                2. Data Integration
                                                                                                                                                                                                                                  1. Data Merging Strategies
                                                                                                                                                                                                                                    1. Horizontal Merging
                                                                                                                                                                                                                                      1. Vertical Merging
                                                                                                                                                                                                                                        1. Key-based Merging
                                                                                                                                                                                                                                        2. Schema Matching
                                                                                                                                                                                                                                          1. Attribute Correspondence
                                                                                                                                                                                                                                            1. Data Type Alignment
                                                                                                                                                                                                                                              1. Value Standardization
                                                                                                                                                                                                                                              2. Entity Resolution
                                                                                                                                                                                                                                                1. Record Matching
                                                                                                                                                                                                                                                  1. Deduplication
                                                                                                                                                                                                                                                    1. Identity Resolution
                                                                                                                                                                                                                                                    2. Data Transformation
                                                                                                                                                                                                                                                      1. Format Standardization
                                                                                                                                                                                                                                                        1. Unit Conversion
                                                                                                                                                                                                                                                          1. Coordinate System Transformation
                                                                                                                                                                                                                                                        2. Data Governance and Ethics
                                                                                                                                                                                                                                                          1. Data Governance Framework
                                                                                                                                                                                                                                                            1. Data Stewardship
                                                                                                                                                                                                                                                              1. Data Policies
                                                                                                                                                                                                                                                                1. Data Standards
                                                                                                                                                                                                                                                                  1. Data Lineage
                                                                                                                                                                                                                                                                  2. Privacy and Security
                                                                                                                                                                                                                                                                    1. Data Anonymization
                                                                                                                                                                                                                                                                      1. Data Masking
                                                                                                                                                                                                                                                                        1. Encryption
                                                                                                                                                                                                                                                                          1. Access Controls
                                                                                                                                                                                                                                                                          2. Regulatory Compliance
                                                                                                                                                                                                                                                                            1. GDPR
                                                                                                                                                                                                                                                                              1. CCPA
                                                                                                                                                                                                                                                                                1. HIPAA
                                                                                                                                                                                                                                                                                  1. SOX

                                                                                                                                                                                                                                                                              Previous

                                                                                                                                                                                                                                                                              3. Computational Foundations and Tools

                                                                                                                                                                                                                                                                              Go to top

                                                                                                                                                                                                                                                                              Next

                                                                                                                                                                                                                                                                              5. Exploratory Data Analysis