Table of Contents:
  • Preface xiii Acknowledgements xv List of Figures xvii List of Tables xxiii List of Abbreviations xxv 1 Advanced Set Theory 1 1.1 Set Theory 1 1.2 Basic Set Theory 2 1.3 The Axioms of Set Theory 4 1.4 Operations on Sets 5 1.5 Families of Sets 7 1.5.1 Indexing of Sets 10 1.6 An Algebra of Sets 10 1.7 The Borel Algebra 12 1.8 Cardinality 13 1.8.1 Equivalence of Sets 13 1.8.2 Countable Sets 14 1.8.3 Uncountable Sets 16 1.8.4 Cardinality Properties 19 1.9 Georg Cantor 20 1.10 Problems 22 2 Relations and Functions 23 2.1 Definition of a Relation 23 2.1.1 Relation Representation 24 2.1.2 Types of Relations 26 2.2 Definition of Function 27 2.2.1 Types of Functions 28 2.3 Mathematical Functions 31 2.3.1 Indicator Function 33 2.3.2 Fuzzy Sets 34 2.3.3 Properties of Set Functions 36 2.4 The Count of Arts and Mathematics 38 2.5 Problems 40 3 Fundamentals of Measure Theory 41 3.1 Measuring History 41 3.2 Measure in an Algebra of Sets 44 3.3 The Riemann Integral 47 3.4 The Lebesgue Integral 54 3.4.1 The Lebesgue Measure 57 3.4.2 Concept of the Lebesgue Integral 61 3.4.3 Properties of the Lebesgue Integral 62 3.5 Henri Lebesgue 66 3.6 Problems 67 4 Generalized Functions 69 4.1 A Note on Generalized Functions 69 4.2 The Unit Step Function 70 4.2.1 Properties of the Unit Step Function 71 4.3 The Signum Function 72 4.4 The Gate Function 73 4.5 The Impulse Function 73 4.5.1 The Functional 79 4.5.2 Properties of the Impulse Function 81 4.5.3 Composite Function with the Impulse 82 4.6 Doublet Generalized Function 85 4.7 The Ramp Function 86 4.8 The Exponential Function 87 4.9 Discrete Functions 89 4.9.1 Discrete Unit Step Function 90 4.9.2 Discrete Impulse Function 90 4.9.3 Discrete Ramp Function 91 4.10 Paul Dirac 94 4.11 Problems 95 5 Probability Theory 97 5.1 Reasoning in Games of Chance 97 5.2 Measurable Space 99 5.2.1 Probability Measure 100 5.2.2 Probability Measure with the Riemann Integral 100 5.2.3 Probability Measure with the Lebesgue Integral 101 5.3 The Axioms of Probability 105 5.4 Axioms of the Expectation Operator 108 5.5 Bayes' Theorem 109 5.6 Andrei Kolmogorov 113 5.7 Problems 114 6 Random Variables 117 6.1 The Concept of a Random Variable 117 6.1.1 Algebra Generated by a Random Variable 119 6.1.2 Lebesgue Measure and Probability 119 6.2 Cumulative Distribution Function 120 6.2.1 Change of Variable Theorem 126 6.3 Moments of a Random Variable 127 6.3.1 Properties Associated to the Expected Value 128 6.3.2 Definition of the Most Important Moments 129 6.4 Functions of Random Variables 132 6.4.1 General Formula for Transformation 138 6.5 Discrete Distributions 144 6.6 Characteristic Function 149 6.7 Conditional Distribution 151 6.8 Useful Distributions and Applications 156 6.9 Carl Friedrich Gauss 164 6.10 Problems 165 7 Joint Random Variables 167 7.1 An Extension of the Concept of Random Variable 167 7.2 Properties of Probability Distributions 171 7.3 Moments in Two Dimensions 172 7.4 Conditional Moments 177 7.5 Two-Dimensional Characteristic Function 178 7.5.1 Sum of Random Variables 180 7.6 Function of Joint Random Variables 181 7.7 Transformation of Random Vectors 186 7.8 Complex Random Variables 188 7.9 F̌lix Borel 190 7.10 Problems 191 8 Probability Fundamental Inequalities 193 8.1 Historical Notes 193 8.2 Tchebychev's Inequality 195 8.3 Markov's Inequality 197 8.4 Bienaym̌'s Inequality 198 8.5 Jensen's Inequality 198 8.6 Chernoff's Inequality 199 8.7 Kolmogorov's Inequality 201 8.8 Schwarz' Inequality 202 8.9 Hl̲der's Inequality 203 8.10 Lyapunov's Inequality 204 8.11 Minkowsky's Inequality 204 8.12 Fatou's Lemma 205 8.13 About Arguments and Proofs 207 8.14 Problems 208 9 Convergence and the Law of Large Numbers 211 9.1 Forms of Convergence in Probability Theory 211 9.2 Types of Convergence 211 9.2.1 Convergence in Probability 212 9.2.2 Almost Sure Convergence 212 9.2.3 Sure Convergence 213 9.2.4 Convergence in Distribution 214 9.2.5 Convergence in Mean of Order r 214 9.2.6 Convergence in Mean 214 9.2.7 Convergence in Mean Square 215 9.2.8 Convergence in Measure 216 9.3 Relationships Between the Types of Convergence 216 9.4 Weak Law of Large Numbers 217 9.5 Strong Law of Large Numbers 219 9.6 Central Limit Theorem 222 9.6.1 Demonstration of the Theorem 222 9.6.2 Central Limit Theorem for Products 225 9.7 Pierre-Simon Laplace 226 9.8 Problems 227 A Formulas and Important Inequalities 231 B Fourier Transform 239 B.1 Table of Fourier Transforms 239 C Commented Bibliography 247 Bibliography 259 Index 265 About the Authors 275.