All 2018 Courses

1. Complex numbers: Cartesian coordinates, polar coordinates. Functions of a complex variable. Basic properties of analytic functions, the exponential function, trigonometric functions. Definition of contour integral. The Cauchy Integral Formula. Residues and poles. Evaluation of impoper real integrals with the use of residues.
2. Inner product functional spaces. Orthogonal and orthonormal systems. Generalized Fourier series. Theorem on orthogonal projection. Bessel’s inequality and Parseval’s equality.
3. Trigonometric Fourier series. Complex form of Fourier series. Fourier series expansion defined over various intervals. Pointwise and uniform convergence of Fourier series. Completness of trigonometric system and Parseval’s equality. Differentiation and integration of Fourier series.
4. The Fourier integral as a limit of Fourier series. The Fourier transform: definition and basic properties. The inverse Fourier transform. The convolution theorem, Parseval’s theorem for the Fourier transform. A relation between Fourier and Laplace transforms. Application of Fourier transform to partial differential equations and image processing.
5. Distributions (generalized functions). The Heaviside step function, the impulse delta-function. Derivative of distribution. Convergence of sequences in the space of distributions. The Fourier transform of distributions.

1. Real numbers (axiomatic theory). Supremum and Infimum of a set. Existence of an n-th root for any a > 0. 2. Convergent sequences, subsequences, Cauchy sequences. The Bolzano-Weierstrass theorem. Upper and lower limits. 3. Series. Partial sums, convergent and divergent series, Cauchy criterion. Series of non-negative terms. The root and the ratio tests. Series of arbitrary terms. Dirichlet, Leibnitz, and Abel theorems. Rearrangements of series. The Riemann Theorem. 4. The limit of a function. Continuous functions. Continuity of the elementary functions. Properties of functions continuous on a closed interval. Uniformly continuous functions. Cantor?s theorem. 5. The derivative of a function. Mean value theorems. Derivatives of higher order. L’Hospital’s rule. Taylor’s theorem.

• Fields: definitions, the field of complex numbers.
• Linear equations: elementary operations, row reduction, homogeneous and inhomogeneous systems, representations of the solutions.
• Vector spaces: examples, subspaces, linear dependence, bases, dimension.
• Matrix algebra: matrix addition and multiplication, elemetary operations, the inverse of a matrix, the determinant, Cramer’s rule.
• Linear transformations: examples, kernel and image, matrix representation.
• Diagonalization: eigenvectors and eigenvalues, the characteristic polynomial, applications.
• Bilinear forms.
• Finite dimensional inner product spaces.
• Operators on finite dimensional inner product spaces: the adjoint, self adjoint operators, normal operators, diagonalization of normal operators.

1. Lines and planes. Cross product. Vector valued functions of a single variable, curves in the plane, tangents, motion on a curve.
2. Functions of several variables: open and closed sets, limits, continuity, differentiability, directional derivatives, partial derivatives, the gradient, scalar and vector fields, the chain rule, the Jacobian. Implicit differentiation and the implicit function theorem. Extremum problems in the plane and in space: the Hessian and the second derivatives test, Lagrange multipliers.
3. Line integrals in the plane and in space, definition and basic properties, work, independence from the path, connection to the gradient, conservative vector field, construction of potential functions. Applications to ODEs: exact equations and integrating factors. Line integral of second kind and arclength.
4. Double and triple integrals: definition and basic properties, Fubini theorem. Change of variable and the Jacobian, polar coordinates in the plane and cylindrical and spherical coordinates in space. Green’s theorem in the plane.
5. Parametric representation of surfaces in space, normals, the area of a parametrized surface, surface integrals including reparametrizations
6. Curl and divergence of vector fields. The theorems of Gauss and Stokes.

State space and transfer functions, stability-state space and input output, observability and controllability, realization theory, Hankel Matrices, statefeedback ans stabilization, Ricatti equations.

The process diffusion limited aggregation, or DLA, is a remarkable process stemming from physics. Although it is known for almost 40 years, it still is mysterious and difficult to mathematically understand. Classically it has been studied in the plane. For this project we will simulate the process in other geometries, Euclidean as well as non-Euclidean. The goal is to obtain large-scale simulations, which may lead to further understanding and new ideas. Further, we will use the simulations repeatedly to measure experimentally different quantities associated with DLA, such as growth rate, fractal dimension, etc.

Sample spaces and finite probability spaces with symmetric simple events, general probabilty spaces and the fields of events, the Borel filed and probabilities on it defined by densities, conditional probabilities and independent events, random variables and their distribution functions (discrete, absolutely continuous, mixed), the expectation of a random variable (for discrete, absolutely continuous and general distribution), the variance of a random variable, random vectors and the covariance, independent random variables, the central limit theorem for i.i.d. random variables, examples related to analysis of simple algorithms, joint densities (discrete or continuous) with computation of the covariance and the marginal distributions, the weak law of large numbers.1. A.M. Mood, F.A. Graybill And D.C.Boes. Introduction To The Theory Of Statistics 3rd Edition, Mcgraw-Hill, 1974. 2. A. Dvoretzky, Probability theory (in Hebrew), Academon, Jerusalem, 1968.3. B. Gnedenko, The theory of Probability, Chelsea 1967 (or Moscow 1982) in English; Russian origina titled ‘A course in probability theory”.

First order differential equations.1. Separable equations.2. Exact equations. Integrating factors.3. Homogeneous equations.4. Linear equations. Equation Bernulli.5. The existence theoremSecond order equations.1. Reduction of order.2. Fundamental solutions of the homogeneous equations3. Linear independence. Liouville formula. Wronskian.4. Homogeneous equations with constant coefficients.5. The nonhomogeneous problem.6. The method of undetermined coefficients.7. The method of variation of parameters. 8. Euler equation.9. Series solutions of second order linear equatHigher order linear equations.1. The Laplace transform2. Definition of the Laplace transform3. Solution of differential equations by method of Laplase transform.4. Step functions.5. The convolution integral.Systems of first order equations.1. Solution of linear systems by elimination.2. Linear homogeneous systems with constant coefficients.3. The matrix method. Eigenvalues and eigenvectors.4. Nonhomogeneous linear systems.

The course discusses elements of linear algebra over the real and complex numbers. 1. The complex numbers. Linear equations: elementary operations, row reduction, homogeneous and non-homogeneous linear equations. 2. Real and complex vector spaces. Examples, subspaces, linear dependence, bases, dimension. 3. Matrix algebra. Matrix addition and multiplication, elementary operations, LU decomposition, inverse matrix, the determinant, Cramer’s law. 4. Linear transformations: examples, kernel and image, matrix representation. 5. Inner products, orthonormal sequences, the Gram-Schmidt process. 6. Diagonalization: eigenvalues and eigenvectors, the characteristic polynomial. Time permitting: unitary and orthogonal matrices and diagonalization of Hermitian and symmetric matrices.

1. Real numbers. Supremum and Infimum of a set. 2. Convergent sequences, subsequences, Cauchy sequences. The Bolzano-Weierstrass theorem. Limit superior and limit inferior. 3. Series. Partial sums, convergent and divergent series, Cauchy criterion. Series of non-negative terms. The root and the ratio tests. Conditional and absolute convergence. The Leibnitz test for series with alternating signs. Rearrangements of series (without proof) 4. The limit of a function. Continuous functions. Continuity of the elementary functions. Properties of functions continuous on a closed interval: boundedness and attainment of extrema. Uniform continuity, Cantor?s theorem. 5. The derivative of a function. Mean value theorems. Derivatives of higher order. L’Hospital’s rule. Taylor’s theorem. Lagrange remainder formula.

1) The system of the real numbers: the natural numbers, well order, the inegers, the rational numbers, arithmetical operations and the field axioms, the order on the rational numbers, the Archimedian axiom, non completeness of the rationals, irrational numbers and the completeness of the reals, bounded sets, upper and lower bounds, maximum and minimum, supremum and infimum, rational and irrational powers, the basic inequalities (Bernoulli, Cauchy-Schwarz, the mean values, Holder, Minkowskii), the rational roots of a polynomial equation over the rational numbers.2) Sequences and their limits, the arithmetic of limits, divergence and tending to infinity, inequalities between sequences and between their limits, the Sandwitch Theorem, monotonic sequences, recursive sequences, Cantor’s Lemma, sub sequences, the Theorem of Bolzano-Weierstrass, the exponent, Cauchy’s criterion for the convergence of a sequence, upper limit, lower limit.3) Functions of a single variable, arithmetic operations on functions, monotone functions, the elementary functions.4) The limit of a function, the sequential definition and non sequential definition, the arithmetic of limits, one sided limits, Cauchy’s criterion, bounded functions, the order of magnitude of a function (big Oh and small Oh).5) Continuous functions, classification of discontinuities, the mean value theorem and its applications, continuity and being monotone.6) The derivative of a function, the graph of a function and the tangent line to the graph, the slope of the tangent line, the velocity, differentiability and continuity, the arithmetic of the differential operator in particular the Liebnitz rule, composition of functions, the chain rule, higher order derivatives, a theorem of Fermat, Roll’s Theorem, the maen value theorem of Lagrange, the mean value theorem of Cauchy, L’hospital rules, Taylor’s Theorem.7) Local and global maximum and minimum, inflection points, convex and concave functions, asymptotic lines, sketching

The aim of the course is to study main principles of probability theory. Such themes as probability spaces, random variables, probability distributions are given in details.Some applications are also considered.1. Probability space: sample space, probability function, finite symmetric probability space, combinatorial methods, and geometrical probabilities.2. Conditional probability, independent events, total probability formula, Bayes formula. 3. Discrete random variable, special distributions: uniform, binomial, geometric, negative binomial, hypergeometric and Poisson distribution. Poisson process.4. Continuous random variable, density function, cummulative distribution function. Special distributions: uniform, exponential, gamma and normal. Transformations of random variables. Distribution of maximum and minimum. Random variable of mixed type.5. Moments of random variable. Expectation and variance. Chebyshev inequality.6. Random vector, joint probability function, joint density function, marginal distributions. Conditional density, covariance and correlation coefficient.7. Central Limit Theorem. Normal approximation. Law of Large Numbers.

First order equations: separable equations, exact equations, linear equations, Bernulli equations. Existence and uniqueness. Second order equations. Reduction of order. Linear homogeneous equations, fundamental solutions and Wronskian. Inhomogeneous equations, variation of parameters. Equations with constant coefficients and the method of undetermined coefficients. Linear equations of higher order. Euler equations. Systems of differential equations. Laplace transform and its properties. Solution of initial value problems with discontinuous forcing functions. Impulse functions. Convolution.

1. Normed spaces and spaces with inner products. The projection theorem for finite dimensional subspaces. Orthogonal systems in infinite dimensional spaces. The Bessel inequality and the Parseval equality, closed orthogonal systems. The Haar system.
2. The Fourier series (in real and complex form). Approximate identities, closedness of the trigonometric / exponential system. Uniform convergence of the Fourier series of piecewise continuously differentiable functions on closed intervals of continuity; the Gibbs phenomenon. Integrability and differentiability term by term.
3. The Fourier transform. The convolution theorem. The Plancherel equality. The inversion theorem. Applications: low pass filters and Shannon’s theorem.
4. The Laplace transform. Basic relations and connection with the Fourier transform. A table of the Laplace transforms. The convolution integral. Application of the Laplace transform for solution of ODEs.
5. Introduction to the theory of distributions. Differentiation of distributions, the delta function and its derivatives. Fourier series, Fourier transforms, and Laplace transforms of distributions.

The system of the real numbers (without Dedekind cuts). The supremum axiom. Convergent sequences, subsequences, monotonic sequences, upper and lower limits. Series: partial sums, convergent and divergent series, examples, nonnegative series, the root test, the quotient test, general series, Dirichlet, Leibnitz, absolute convergence implies convergence (without a proof). Limits of functions, continuity, the continuity of the elementary functions, extrema in compact intervals. The derivative of a function, Lagrange’s Mean Value Theorem, high order derivatives, L’hospital’s rules, Taylor’s Theorem, error estimates, lots of examples. The Riemann integral: only for piecewise continuous functions (finitely many points of discontinuity). Riemann sums and the definition of the integral, The Fundamental Theorem of Calculus, the existence of primitive functions (anti-derivatives). Integration techniques: integration by parts, substitutions, partial fractions (without proofs), improper integrals, applications of integrals, estimation of series with the aid of integrals, Hardy’s symbols O, o and Omega, approximation of momenta and the Stirling formula.

1. General background: sets and operations on them, Complex numbers: definition (via ordered pairs), addition and multiplication, inverses, adjoint, absolute value. Real and complex polynomials and their roots.
2. Fields: Definition, properties, examples: Rationals, reals, complex numbers, integers mod p.
3. Linear equations over fields, matrices and elementary row operations, rank of a matrix, solutions of homogeneous and non homogeneous systems of linear equations and the connections between them.
4. Vector spaces over fields, subspaces, bases and dimensions, coordinates change of coordinate matrix, row rank as rank of a subspace, sums, direct sums of subspaces and the dimension theorem.
5. Matrices multiplication, the algebra of square matrices, inverse determinants: properties, Cramer’s rule, adjoint and its use for finding the inverse.
6. Linerar transformationsbasic propertieskernel and image of a linear trasformationrepresentaion of linear transformations by matrices and the effect of change of bases.linear functionals, dual bases

1. Review of probability: a. Basic notions. b. Random variables, Transformation of random variables, Independence. c. Expectation, Variance, Co-variance. Conditional Expectation.
2. Probability inequalities: Mean estimation, Hoeffding?s inequality.
3. Convergence of random variables: a. Types of convergence. b. The law of large numbers. c. The central limit theorem.
4. Statistical inference: a. Introduction. b. Parametric and non-parametric models. c. Point estimation, confidence interval and hypothesis testing.
5. Parametric point estimation: a. Methods for finding estimators: method of moments; maximum likelihood; other methods. b. Properties of point estimators: bias; mean square error; consistency c. Properties of maximum likelihood estimators. d. Computing of maximum likelihood estimate
6. Parametric interval estimation a. Introduction. b. Pivotal Quantity. c. Sampling from the normal distribution: confidence interval for mean, variance. d. Large-sample confidence intervals.
7. Hypothesis testing concepts: parametric vs. nonparametric a. Introduction and main definitions. b. Sampling from the Normal distribution. c. p-values. d. Chi-square distribution and tests. e. Goodness-of-fit tests. f. Tests of independence. g. Empirical cumulative distribution function. Kolmogorov-Smirnov Goodness-of fit test.
8. Regression. a. Simple linear regression. b. Least Squares and Maximum Likelihood. c. Properties of least Squares estimators. d. Prediction.
9. Handling noisy data, outliers.

Fields. Fields of rational, real and complex numbers. Finite fields. Calculations with complex numbers. Systems of linear equations. Gauss elimination method. Matrices. Canonical form of a matrix. Vector spaces . Homogeneous and non homogeneous systems. Vector spaces. Vector spaces. Vector subspace generated by a system of vectors. Vector subspace of solutions of a system of linear homogeneous equations. Linear dependence. Mutual disposition of subspaces. Basis and dimension of a vector space. Rank of a matrix. Intersection and sum of vector subspaces. Matrices and determinants. Operations with matrices. Invertible matrices. Change of a basis. Determinants. Polynomials over fields. Divisibility. Decomposition into prime polynomials over R and over C. Linear transformations and matrices. Linear transformations and matrices. Kernel and image. Linear operators and matrices. Algebra of linear operators. Invertible linear operators. Eigenvectors and eigenvalues of matrices and linear operators. Diagonalization of matrices and linear operators. Scalar multiplication. Orthogonalization process of Gram-Shmidt. Orthogonal diagonalization of symmetric matrices.

1. Real numbers (axiomatic theory). Supremum and Infimum of a set. Existence of an n-th root for any a > 0. 2. Convergent sequences, subsequences, Cauchy sequences. The Bolzano-Weierstrass theorem. Upper and lower limits. 3. Series. Partial sums, convergent and divergent series, Cauchy criterion. Series of non-negative terms. The root and the ratio tests. Series of arbitrary terms. Dirichlet, Leibnitz, and Abel theorems. Rearrangements of series. The Riemann Theorem. 4. The limit of a function. Continuous functions. Continuity of the elementary functions. Properties of functions continuous on a closed interval. Uniformly continuous functions. Cantor?s theorem. 5. The derivative of a function. Mean value theorems. Derivatives of higher order. L’Hospital’s rule. Taylor’s theorem.

1. The Riemann integral: Riemann sums, the fundamental theorem of calculus. Methods for computing integrals (integration by parts, substitution, partial fractions). Improper integrals and application to series. Numerical integration. Stirling’s formula and additional applications time permitting.
2. Uniform and pointwise convergence. Cauchy’s criterion and the Weierstrass M-test. Power series. Taylor series, analytic and non-analytic functions. Convolutions, approximate identities and the Weierstrass approximation theorem. Additional applications time permitting.
3. A review of vectors in R^n and linear maps. The Euclidean norm and the Cauchy-Schwarz inequality. Basic topological notions in R^n. Continuous functions of several variables. Curves in R^n, arc-length. Partial and directional derivatives, differentiability and C^1 functions. The chain rule. The gradient. Implicit functions and Lagrange multipliers. Extrema in bounded domains.

1. Normed spaces and spaces with inner products. The projection theorem for finite dimensional subspaces. Orthogonal systems in infinite dimensional spaces. The Bessel inequality and the Parseval equality, closed orthogonal systems. The Haar system.
2. The Fourier series (in real and complex form). Approximate identities, closedness of the trigonometric / exponential system. Uniform convergence of the Fourier series of piecewise continuously differentiable functions on closed intervals of continuity; the Gibbs phenomenon. Integrability and differentiability term by term.
3. The Fourier transform. The convolution theorem. The Plancherel equality. The inversion theorem. Applications: low pass filters and Shannon’s theorem.
4. The Laplace transform. Basic relations and connection with the Fourier transform. A table of the Laplace transforms. The convolution integral. Application of the Laplace transform for solution of ODEs.
5. Introduction to the theory of distributions. Differentiation of distributions, the delta function and its derivatives. Fourier series, Fourier transforms, and Laplace transforms of distributions.

1. Complex numbers, open sets in the plane.
2. Continuity of functions of a complex variable
3. Derivative at a point and Cauchy–Riemann equations
4. Analytic functions; example of power series and elementary functions
5. Cauchy’s theorem and applications.
6. Cauchy’s formula and power series expansions
7. Morera’s theorem
8. Existence of a logarithm and of a square root
9. Liouville’s theorem and the fundamental theorem of algebra
10. Laurent series and classification of isolated singular points. The residue theorem
11. Harmonic functions
12. Schwarz’ lemma and applications
13. Some ideas on conformal mappings
14. Computations of integrals

The aim of the course is to train students in creative problem solving in various areas of mathematics, in a manner simulating, to some extent, mathematical research (rather than ordinary courses, where homework assignments are, usually closely ? and quite obviously - related to the topics reviewed in class). The course will focus on problems whose solutions call for tools and ideas from several fields of mathematics, and will reveal ? on a miniature scale - the beauty of mathematics as an integral field of knowledge, where between seemingly unrelated subjects deep and surprising connections may arise. The problems will focus on topics in classical and modern mathematics that, due mostly to their interdisciplinary nature, are not ? as a rule ? covered in the core classes offered by the department (such topics as the axiom of choice and its applications, the Banach-Tarski paradox, transcendental number theory etc.). Classes will be divided between lectures, given by the instructor, filling in background material required to address the problems in question, and between students’ presentation of their solutions to the work sheets distributed previously. In addition to all of the above, the course will help students improve their skills in searching the mathematical literature and in the art of writing and presenting proofs.

The system of the real numbers (without Dedekind cuts). The supremum axiom. Convergent sequences, subsequences, monotonic sequences, upper and lower limits. Series: partial sums, convergent and divergent series, examples, nonnegative series, the root test, the quotient test, general series, Dirichlet, Leibnitz, absolute convergence implies convergence (without a proof). Limits of functions, continuity, the continuity of the elementary functions, extrema in compact intervals. The derivative of a function, Lagrange’s Mean Value Theorem, high order derivatives, L’hospital’s rules, Taylor’s Theorem, error estimates, lots of examples. The Riemann integral: only for piecewise continuous functions (finitely many points of discontinuity). Riemann sums and the definition of the integral, The Fundamental Theorem of Calculus, the existence of primitive functions (anti-derivatives). Integration techniques: integration by parts, substitutions, partial fractions (without proofs), improper integrals, applications of integrals, estimation of series with the aid of integrals, Hardy’s symbols O, o and Omega, approximation of momenta and the Stirling formula.

1. Integral calculus in one variable and its application: the integral, Riemann sums, integrability of bounded functions with countably many discontinuity points (the proofs only for continuous functions and monotone functions), antiderivatives and the Fundamental Theorem of Calculus, change of variables and integrations by parts, partial fractions (without proofs). Applications of integral calculus: computation of areas, volume of the solid of revolution, the length of a smooth curve. Improper integral, and convergence tests for positive functions, application to series.
2. Functions of several variables: open, closed, and compact sets, level curves and surfaces, vector valued functions, paths and path-connectedness.
3. Limits and continuity in several variables: arithmetic of limits, Weierstrass theorem, intermediate value theorem.
4. Multivariable differential calculus: partial and directional derivatives, differentiability and the tangent plane, the chain rule, the orthogonality of the gradient to the level surfaces, implicit function theorem for a curve in the plane and a surface in the space (without a proof), the Hessian, Taylor approximation of order 2, critical points (classification only in dimension 2), Extremum problem, including Lagrange multipliers and gradient descent.
5. Integration in dimension 2: Reimann integral in dimension 2, change of variables and Fubini theorem (without proofs), changing the order of integration, polar coordinates, computation of volumes. If time permits: integration in dimension 3.

Prerequisites: 20119531 Linear Algebra

Brief syllabus

1. Operations over sets, logical notation, relations.

2. Enumeration of combinatorial objects: integer numbers, functions, main principles of combinatorics.

3. Elementary combinatorics: ordered and unordered sets and multisets, binomial and multinomial coefficients.

4. Principle of inclusion and exclusion, Euler function.

5. Graphs: representation and isomorphism of graphs, valency, paths and cycles.

6. Recursion and generating functions: recursive definitions, usual and exponential generating functions, linear recurrent relations with constant coefficients.

7. (Optional) Modular arithmetics: congruences of integer numbers, $\mathbb{Z}_m$, invertible elements in $\mathbb{Z}_m$.

1. General background: sets and operations on them, Complex numbers: definition (via ordered pairs), addition and multiplication, inverses, adjoint, absolute value. Real and complex polynomials and their roots.
2. Fields: Definition, properties, examples: Rationals, reals, complex numbers, integers mod p.
3. Linear equations over fields, matrices and elementary row operations, rank of a matrix, solutions of homogeneous and non homogeneous systems of linear equations and the connections between them.
4. Vector spaces over fields, subspaces, bases and dimensions, coordinates change of coordinate matrix, row rank as rank of a subspace, sums, direct sums of subspaces and the dimension theorem.
5. Matrices multiplication, the algebra of square matrices, inverse determinants: properties, Cramer’s rule, adjoint and its use for finding the inverse.
6. Linerar transformationsbasic propertieskernel and image of a linear trasformationrepresentaion of linear transformations by matrices and the effect of change of bases.linear functionals, dual bases

• Rings. Ring of polynomials and its ideal structure. The prime factorization of a polynomial. Lagrange interpolation.
• Eigenvalues and eigenvectors of linear operators. Characteristic polynomial and Cayley–Hamilton theorem. The primary decomposition theorem. Diagonalization. Nilpotent operators. Jordan decomposition in small dimension. Jordan decomposition in general dimension- time permitting.
• Linear forms. Dual basis. Bilinear forms. Inner product spaces. Orthogonal bases. Projections. Adjoint linear transformation. Unitary and Hermitian operators. Normal operators and the spectral decomposition theorem. Singular value decomposition theorem and applications.

Optional topics:

• Quadratic forms.
• Sylvester theorem.
• Classification of quadrics in two-dimensional spaces.

Probability theory: discrete and continuous variables, independent vs dependent variables, six basic discrete distributions: Bernoulli, binomial, uniform, geometric, negative binomial, Poissonian. Mean, variance, moments, probability generating function. Five basic continuous distributions: uniform, normal, exponential, gamma, beta. Moment generating function. Events, conditional probability, aging of molecules, entropy and related concepts, scores and support. Generating various probabilities. Many random variables. EST library. Covariance and correlation, iid, minimum and maximum of many random variables.Theoretical statistics; random sampling. Classical vs Bayesian approach. Distributions of the mean and variance of the sample; methods of calculating point estimates; point estimator for the mean; point estimator for the variance; biased vs unbiased, MSE, confidence intervals for the parameters of distribution. Basic ideas and definitions for the test of the hypothesis; errors of type I and II; P-values, tests for mean values, variances and proportions; test for the goodness of fit; test of independence; correlation coefficient; and its tests; linear regression; Likelihood ratios, information and support; maximum value as test statistic. Nonparametric: Mann-Whitney and permutation tests.Bayesian approach to hypothesis testing and estimation.ANOVA - analysis of variance: one-way and two-way.More theory on classical estimation: optimality aspects.BLAST.

1. Review of probability: a. Basic notions. b. Random variables, Transformation of random variables, Independence. c. Expectation, Variance, Co-variance. Conditional Expectation.
2. Probability inequalities: Mean estimation, Hoeffding?s inequality.
3. Convergence of random variables: a. Types of convergence. b. The law of large numbers. c. The central limit theorem.
4. Statistical inference: a. Introduction. b. Parametric and non-parametric models. c. Point estimation, confidence interval and hypothesis testing.
5. Parametric point estimation: a. Methods for finding estimators: method of moments; maximum likelihood; other methods. b. Properties of point estimators: bias; mean square error; consistency c. Properties of maximum likelihood estimators. d. Computing of maximum likelihood estimate
6. Parametric interval estimation a. Introduction. b. Pivotal Quantity. c. Sampling from the normal distribution: confidence interval for mean, variance. d. Large-sample confidence intervals.
7. Hypothesis testing concepts: parametric vs. nonparametric a. Introduction and main definitions. b. Sampling from the Normal distribution. c. p-values. d. Chi-square distribution and tests. e. Goodness-of-fit tests. f. Tests of independence. g. Empirical cumulative distribution function. Kolmogorov-Smirnov Goodness-of fit test.
8. Regression. a. Simple linear regression. b. Least Squares and Maximum Likelihood. c. Properties of least Squares estimators. d. Prediction.
9. Handling noisy data, outliers.

Fields. Fields of rational, real and complex numbers. Finite fields. Calculations with complex numbers. Systems of linear equations. Gauss elimination method. Matrices. Canonical form of a matrix. Vector spaces . Homogeneous and non homogeneous systems. Vector spaces. Vector spaces. Vector subspace generated by a system of vectors. Vector subspace of solutions of a system of linear homogeneous equations. Linear dependence. Mutual disposition of subspaces. Basis and dimension of a vector space. Rank of a matrix. Intersection and sum of vector subspaces. Matrices and determinants. Operations with matrices. Invertible matrices. Change of a basis. Determinants. Polynomials over fields. Divisibility. Decomposition into prime polynomials over R and over C. Linear transformations and matrices. Linear transformations and matrices. Kernel and image. Linear operators and matrices. Algebra of linear operators. Invertible linear operators. Eigenvectors and eigenvalues of matrices and linear operators. Diagonalization of matrices and linear operators. Scalar multiplication. Orthogonalization process of Gram-Shmidt. Orthogonal diagonalization of symmetric matrices.

1. Lines and planes. Cross product. Vector valued functions of a single variable, curves in the plane, tangents, motion on a curve.
2. Functions of several variables: open and closed sets, limits, continuity, differentiability, directional derivatives, partial derivatives, the gradient, scalar and vector fields, the chain rule, the Jacobian. Implicit differentiation and the implicit function theorem. Extremum problems in the plane and in space: the Hessian and the second derivatives test, Lagrange multipliers.
3. Line integrals in the plane and in space, definition and basic properties, work, independence from the path, connection to the gradient, conservative vector field, construction of potential functions. Applications to ODEs: exact equations and integrating factors. Line integral of second kind and arclength.
4. Double and triple integrals: definition and basic properties, Fubini theorem. Change of variable and the Jacobian, polar coordinates in the plane and cylindrical and spherical coordinates in space. Green’s theorem in the plane.
5. Parametric representation of surfaces in space, normals, the area of a parametrized surface, surface integrals including reparametrizations
6. Curl and divergence of vector fields. The theorems of Gauss and Stokes.

• Fields: definitions, the field of complex numbers.
• Linear equations: elementary operations, row reduction, homogeneous and inhomogeneous systems, representations of the solutions.
• Vector spaces: examples, subspaces, linear dependence, bases, dimension.
• Matrix algebra: matrix addition and multiplication, elemetary operations, the inverse of a matrix, the determinant, Cramer’s rule.
• Linear transformations: examples, kernel and image, matrix representation.
• Diagonalization: eigenvectors and eigenvalues, the characteristic polynomial, applications.
• Bilinear forms.
• Finite dimensional inner product spaces.
• Operators on finite dimensional inner product spaces: the adjoint, self adjoint operators, normal operators, diagonalization of normal operators.

The course provides a basic introduction to “naive” set theory, propositional logic and predicate logic. The course studies many important concepts which serve as the building blocks for any mathematical theory An emphasis is given to clear proof writing and correct usage of the mathematical language.A. Basics of Set Theory1. The notion of a set. Set operations: union, intersection, difference, complementation, and the power set.2. Cartesian products and binary relations. Operations on relations.3. Functions: domain and range, one to one and onto. Composition.4. Equivalence relations and set partitions.5. Order relations: partial, linear and well-founded.6. Induction theorems: mathematical, complete and well-founded.B. Set Cardinality1. The notion of cardinality. Finite, infinite and countable sets.2. Cantor’s theorem.3. The cardinality of the set of real numbers and other sets.C. Propositional Calculus1. The language of propositional calculus. Logical connectives.2. Logical implication and logical equivalence of propositional formulas.3. Disjunctive normal form.4. Complete sets of logical connectives.D. Predicate Calculus (First Order Logic)1. The language of predicate calculus: terms, formulas, sentences.2. Structures, assignments for a given structure.3. Logical implication and logical equivalence of first order formulas.4. Elementary equivalence of structures, definable sets in a given structure.

1. Real numbers. Supremum and Infimum of a set. 2. Convergent sequences, subsequences, Cauchy sequences. The Bolzano-Weierstrass theorem. Limit superior and limit inferior. 3. Series. Partial sums, convergent and divergent series, Cauchy criterion. Series of non-negative terms. The root and the ratio tests. Conditional and absolute convergence. The Leibnitz test for series with alternating signs. Rearrangements of series (without proof) 4. The limit of a function. Continuous functions. Continuity of the elementary functions. Properties of functions continuous on a closed interval: boundedness and attainment of extrema. Uniform continuity, Cantor?s theorem. 5. The derivative of a function. Mean value theorems. Derivatives of higher order. L’Hospital’s rule. Taylor’s theorem. Lagrange remainder formula.

1. The Riemann integral: Riemann sums, the fundamental theorem of calculus and the indefinite integral. Methods for computing integrals: integration by parts, substitution, partial fractions. Improper integrals and application to series. 2. Uniform and pointwise convergence. Cauchy criterion and the Weierstrass M-test. Power series. Taylor series. 3. First order ODE’s: initial value problem, local uniqueness and existence theorem. Explicit solutions: linear, separable and homogeneous equations, Bernoulli equations. 4. Systems of ODE’s. Uniqueness and existence (without proof). Homogeneous systems of linear ODE’s with constant coefficients. 5. Higher order ODE’s: uniqueness and existence theorem (without proof), basic theory. The method of undetermined coefficients for inhomogeneous second order linear equations with constant coefficients. The harmonic oscillator and/or RLC circuits. If time permits: variation of parameters, Wronskian theory.

Logic and Set theory: propositional calculus, boolean operators and their truth tables, truth values of formulae, logical equivalence and logical inference, tautologies and contradictions, the important tautologies, e.g., the distributive laws and De Morgan formulae. Sets: inclusion, union, intersection, difference, cartesian product, relations, equivalence relations, partial orders, linear orders, and functions. Basic Combinatorics: induction, basic counting arguments, binomial coefficients, inclusion-exclusion, recursion and, generating functions. Graphs: general notions and examples, isomorphism, connectivity, Euler graphs, trees.

1. Complex numbers: Cartesian coordinates, polar coordinates. Functions of a complex variable. Basic properties of analytic functions, the exponential function, trigonometric functions. Definition of contour integral. The Cauchy Integral Formula. Residues and poles. Evaluation of impoper real integrals with the use of residues.
2. Inner product functional spaces. Orthogonal and orthonormal systems. Generalized Fourier series. Theorem on orthogonal projection. Bessel’s inequality and Parseval’s equality.
3. Trigonometric Fourier series. Complex form of Fourier series. Fourier series expansion defined over various intervals. Pointwise and uniform convergence of Fourier series. Completness of trigonometric system and Parseval’s equality. Differentiation and integration of Fourier series.
4. The Fourier integral as a limit of Fourier series. The Fourier transform: definition and basic properties. The inverse Fourier transform. The convolution theorem, Parseval’s theorem for the Fourier transform. A relation between Fourier and Laplace transforms. Application of Fourier transform to partial differential equations and image processing.
5. Distributions (generalized functions). The Heaviside step function, the impulse delta-function. Derivative of distribution. Convergence of sequences in the space of distributions. The Fourier transform of distributions.