Machine Learning – A.I.

1. Programming Language

What is programming language?
Overview of Python, version and why use Python?
Hardware overview
Python versions and editors
Python installation on Windows and Linux( With IDE)
Using the Python interpreter interactively
Jupyter Installation for Python
Python program using script
Python2 and Python3 differences
Practice,Questions and exercise

2. Getting Started

Using variables
String types and its methods
Number types and in-built functions
Math operators and expressions
Comparison and chained comparison operators
Structure of Python script
Command line parameters
Comments in Python
Practice, Questions and exercise

3. Control Flow

Defining flow control and its usage
Python indentation
Conditional statements(If and else)
Iteration and boolean expressions
While loops
Using the for statement
Break, continue and Pass statements
range() function(Python2 and Python3)
range() usage in iteration
Practice, Questions and exercise

4. Data Structure

What is data structure?
Linear data structures and its types
What are stack, queue and deque
list and associated methods
list as stack, queue and deque
Use of strings
Tuple and associated methods
Search algorithms and implementation
Set and associated methods
Dictionary and associated methods
Practice, Questions and exercise

5. Functions

What are functions?
Defining and calling functions
Functions argument values
Default & keyword argument values
Init function & self argument
Arbitrary & unpacking argument lists
Built-in functions
Variables Scope
Passing function to function
Decorators
Lambda
Practice, Questions and exercise

6. Modules and Packages

What are modules?
Importing modules
Standard modules - sys
Datetime and Math modules
The dir and help function
list and dictionary comprehensions
Regular expressions(RE)
RE objects and pattern matching
RE match and search function
Practice, Questions and exercise

7. OOPs

What are classes and objects?
Defining classes and attributes
Constructor
Instance Methods
Inheritance
Abstraction and Encapsulation
Polymorphism
Method hiding
private,public and protected variables
Implementing stack, queue , deque and linked list
Class and static methods decorators
Special methods
Practice, Questions and exercise

8. Advance Python Library

Introduction to NumPy and Pandas
Creating NumPy arrays from Python structure
indexing and Slicing arrays
rearrange and linspace methods
what is Pandas used for
pandas series
what is data frames ?
Creating data frames
Reading csv, excel and txt files
Practice, Questions and exercise

1. Plotting for exploratory data analysis (EDA)

Iris dataset
Data-point, vector, observation
Dataset
Input variables/features/dimensions/independent variable
Output Variable/Class Label/ Response Label/ dependent variable
Scatter-plot: 2D, 3D.
Pair plots.
PDF, CDF, Univariate analysis.
Histogram and PDF
Univariate analysis using PDFs.
Cumulative distribution function (CDF)
Mean , Variance, Std-dev
Median, Percentiles, Quantiles, IQR, MAD and Outliers.
Box-plot with whiskers
Violin plots.
Summarizing plots.
Univariate, Bivariate and Multivariate analysis.
Multivariate probability density, contour plot.
Exercise: Perform EDA on Iris dataset.

2. Probability and Statistics

Introduction to Probability and Stats
Why learn it?
P(X=x1) , Dice and coin example
Random variables: discrete and continuous.
Outliers (or) extreme points.
Population & Sample.
Gaussian/Normal Distribution
Examples: Heights and weights.
Why learn about distributions.
Mu, sigma: Parameters
Symmetric distribution, Skewness and Kurtosis
Standard normal variate (z) and standardization.
Kernel density estimation.
Sampling distribution & Central Limit theorem.
Q-Q Plot: Is a given random variable Gaussian distributed?

3. Probability - 2.

Uniform Distribution and random number generators
Discrete and Continuous Uniform distributions.
How to randomly sample data points.
Bernoulli and Binomial distribution
Log-normal and power law distribution:
Log-normal: CDF, PDF, Examples.
Power-law & Pareto distributions: PDF, examples
Converting power law distributions to normal: Box-Cox/Power transform.

4. Inferential Statistics

Correlation
Co-variance
Pearson Correlation Coefficient
Spearman Rank Correlation Coefficient
Correlation vs Causation
Confidence Intervals
Confidence Interval vs Point estimate.
Computing confidence-interval given a distribution.
For mean of a random variable
Known Standard-deviation: using CLT
Unknown Standard-deviation: using t-distribution
Confidence Interval using empirical bootstrap
Hypothesis testing
Hypothesis Testing methodology, Null-hypothesis, test-statistic, p-value.
Resampling and permutation test.
K-S Test for similarity of two distributions.

1.Introduction of Machine Learning

Motivation of machine learning
Use cases of machine learning
Future scope of machine learning
Real world domain using ML
Types of machine learning
Different tools/framework available for ML
Limitation of machine learning

2. Basics of Machine Learning

Understanding supervised & unsupervised learning.
Understanding Parametric and non Parametric Algorithm.
Regression and Classification.
Clustering techniques.
TF-IDF and vectorization techniques.

3. Machine Learning with Tensorflow

Motivation for deep learning
Case studies of deep learning
Revolution of Artificial Intelligence
Advantages of deep learning over machine learning
Real-life use cases of Deep Learning
Required linear algebra and statistics

4. Introduction of Artificial Neural Networks

Deep learning: A revolution in Artificial Intelligence
What is Neural Networks and historical background?
Neural networks vs. conventional computers
Basic structure of ANNs
How neural networks works?

5. Tensorflow Basics

What is Tensorflow?
TensorFlow in deep learning
Installation of tensorflow
Tensorflow code-basics
Constants, Placeholders, Variables, Scope, Graph,
Creating and saving a model
Re-Store a model
Running a simple ML algorithm on TensorFlow
Tensor Board: Graph visualization
Tensor Projector: Training pipe line visualization
MLP digit-Classifier using TensorFlow

6. Optimizers

What are optimization algorithms?
Derivatives of optimization algorithms
Gradient Descent
Stochastic gradient descent
Mini Batch Gradient Descent
Momentum
Adagrad
Adam

7. Activation Functions

What are activation functions?
Derivatives of activation functions
Step Activation Function
Sigmoid Activation function
Hyperbolic Tangent function- Tanh
ReLu- Rectified Linear units
Softmax Regression

8. Keras: A High Level API

Introduction to Keras
Keras vs TFLearn
Compose models in Keras
Sequential and functional composition
Predefined neural network layers
Using inception v3 predefined model
Batch normalization: Keras
Saving and Loading a model with Keras
Customizing the training process
Tensor-board: With Keras
Use-Case implementation with Keras

9. Tuning of Hyper-parameters

Train, Dev & Test sets
Bias & Variance
Regularization & Overfitting
Why regularization reduces overfitting?
L1/L2 & Dropout Regularization
Vanishing / Exploding gradients
Weight Initialization for Deep Networks
Numerical approximation of gradients
Normalizing activations in a network
Why does Batch Norm work?

10. Miscellaneous

What are computation graph?
derivatives with a computation graph
Broadcasting in Numpy/Tensorflow
Neural Network Representation
Computing a Neural Network's Output
Explanation for Vectorized Implementation
Parameters vs Hyper-parameters
Forward and Backward Propagation

1. Supervised Learning - Regression Problems

Simple Linear Regression
Linear regression with multiple variables
Linear Regression using Gradient Descent
Ridge and Lasso Regression Logistic Regression
Hands on with Regression problems using Tensorflow

2. Supervised Learning - Classification Problems

K-Nearest Neighbours
Decision Tree
Random Forests
Linear Discriminant Analysis
What is conditional probability?
Use Naive Bayes with python.

3. K-Nearest Neighbours

What is KNN classifier?
Calculate K in KNN?
Distance metrics: Euclidean and scaled Euclidean
Distance metrics: Cosine similarity
Complexity of brute force search
KD-tree representation
NN search with KD-trees
Complexity of NN search with KD-trees
Visualizing scaling behaviour of KD-trees

4. Support Vector Machines (SVM)

Learn the simple intuition behind SVM.
Maximal-Margin Classifier
Choose the right kernel for your SVM
Learn about RBF and linear kernels

5. Outliers

Remove outliers to improve the quality of your linear regression predictions
Remove the residuals on a real dataset and reimplement your regressor
Understanding of outliers and residuals on the Enron Email Corpus Understanding of outliers and residuals on the Enron Email Corpus

6. Dimensionality Reduction Techniques

Principle Component Analysis
TSNE
Multicollinearity
Hands on with Dimensionality reduction in Tensorflow

7. Decision Trees & Random Forests

Characteristics of Tree Models
Supervised Segmentation in Modeler
Defining Terms, Trees and Rules
What is CHAID
How does the CHAID algorithm work?
Building a quick CHAID model
Using Autoclassifer to run multiple CHAID settings
How does the C&RT algorithm work?
Surrogates for Missing Data
C&RT's Expert Settings
CHAID Expert Settings
What is Bagging and Boosting?

8. k-Means Algorithm

An unsupervised task
Hope for unsupervised learning, and some challenge cases
The k-means algorithm
k-means as coordinate descent
Smart initialization via k-means++
Other applications of clustering

1. Designing of ML Project

Orthogonalization
When to change dev/test sets and metrics
Why human-level performance?
Avoidable bias
Understanding human-level performance
Surpassing human-level performance
Improving your model performance

2. Projects

Handwritten digit classification
Recommender systems
Emotion/Sentiment Analysis

3. Test: Outliers

Carrying out error analysis
Cleaning up incorrectly label data
Build your first system quickly, then iterate
Training and testing on different distributions
Bias and Variance with mismatched data distributions
Addressing data mismatch
Transfer learning
Multi-task learning