10 relations: Bernoulli distribution, Binary entropy function, Binary symmetric channel, Channel (communications), Channel capacity, Code, Coding theory, Conditional probability, Information theory, Random variable.
In probability theory and statistics, the Bernoulli distribution, named after Swiss scientist Jacob Bernoulli, is the probability distribution of a random variable which takes the value 1 with success probability of p and the value 0 with failure probability of q.
In information theory, the binary entropy function, denoted H(p) \, or H_(p) \,, is defined as the entropy of a Bernoulli process with probability of success p. Mathematically, the Bernoulli trial is modelled as a random variable X that can take on only two values: 0 and 1.
A binary symmetric channel (or BSC) is a common communications channel model used in coding theory and information theory.
In telecommunications and computer networking, a communication channel or channel, refers either to a physical transmission medium such as a wire, or to a logical connection over a multiplexed medium such as a radio channel.
In electrical engineering, computer science and information theory, channel capacity is the tight upper bound on the rate at which information can be reliably transmitted over a communications channel.
In communications and information processing, code is a system of rules to convert information—such as a letter, word, sound, image, or gesture—into another form or representation, sometimes shortened or secret, for communication through a channel or storage in a medium.
Coding theory is the study of the properties of codes and their fitness for a specific application.
In probability theory, a conditional probability measures the probability of an event given that (by assumption, presumption, assertion or evidence) another event has occurred.
Information theory is a branch of applied mathematics, electrical engineering, and computer science involving the quantification of information.
In probability and statistics, a random variable, aleatory variable or stochastic variable is a variable whose value is subject to variations due to chance (i.e. randomness, in a mathematical sense).