Wiki Article · Cinematic

Activation function

Activation function ek mathematical function hota hai jo neural network ke neuron/layer ke output…

Overview

Activation function — Quick Facts

📌

Field: Value

🎯

Term: Activation function

⚡

Type: Mathematical function used in…

🔑

Primary purpose: Non-linearity add karna + signal…

Topic 1

Infobox

📚 | Field | Value | |---|---| | Term | Activation function | | Type | Mathematical function…

Topic 2

Overview

💡

Har layer ek input signal leti hai,

🔑

Kuch calculation karti hai,

⚡

Aur output signal next layer ko…

Topic 3

Why activation is needed

💡

Agar har layer sirf “add/multiply”…

🔑

Real world problems (images,…

⚡

Non-linear decision boundaries…

🎯

Output ko bounded rakh sakta hai…

Topic 4

How it works in a neuron

💡

Inputs: $x_1, x_2, \dots, x_n$

🔑

Weights: $w_1, w_2, \dots, w_n$

⚡

Bias: $b$

🎯

$z = w \cdot x + b$ (yahan $w…

Topic 5

Common activation functions

💡

ReLU: negative inputs ko 0 bana…

🔑

Sigmoid: output ko 0 aur 1 ke…

⚡

Tanh: sigmoid jaisa, but -1 se 1…

🎯

Softmax: multiple class scores ko…

Topic 6

Choosing an activation (practical)

✨ Wiki: Aliens Wiki Language: HIEN Topic: Activation function Slug: Activation_function…

Topic 7

Infobox

🌟 | Field | Value | |---|---| | Term | Activation function | | Type | Mathematical function…

Topic 8

Overview

💡

Har layer ek input signal leti hai,

🔑

Kuch calculation karti hai,

⚡

Aur output signal next layer ko…

Topic 9

Why activation is needed

💡

Agar har layer sirf “add/multiply”…

🔑

Real world problems (images,…

⚡

Non-linear decision boundaries…

🎯

Output ko bounded rakh sakta hai…

Topic 10

How it works in a neuron

💡

Inputs: $x_1, x_2, \dots, x_n$

🔑

Weights: $w_1, w_2, \dots, w_n$

⚡

Bias: $b$

🎯

$z = w \cdot x + b$ (yahan $w…

Topic 11

Common activation functions

💡

ReLU: negative inputs ko 0 bana…

🔑

Sigmoid: output ko 0 aur 1 ke…

⚡

Tanh: sigmoid jaisa, but -1 se 1…

🎯

Softmax: multiple class scores ko…

Topic 12

Choosing an activation (practical)

💡

Hidden layers: ReLU-family ko…

🔑

Output layer: task ke hisaab se…

⚡

Output activation aur loss…

Topic 13

Training implications

💡

Vanishing gradient: sigmoid/tanh…

🔑

Exploding gradient: kuch setups me…

⚡

Dead ReLU: agar neuron ka $z$…

Topic 14

Performance considerations

💡

Compute cost: kuch activations…

🔑

Numerical stability: softmax (aur…

Topic 15

Common mistakes

💡

Wrong output activation:

🔑

Regression output par…

⚡

Multi-class single-label case me…

🎯

Logits vs probabilities confuse…

Topic 16

Security and privacy considerations

💡

Training stability issues…

🔑

Some attack/defense techniques…

Topic 17

Glossary

💡

Neuron: neural network ka basic…

🔑

Layer: neurons ka group.

⚡

Weight: input ko scale karne wala…

🎯

Bias: constant offset parameter.

Diagram

Visual Flow

📊 Diagram visualization — details in narration

Diagram

Visual Flow

📊 Diagram visualization — details in narration

Quiz — Question 1

Activation function ka sabse sahi definition kya hai?

Quick Quiz

Quiz — Question 2

Activation function ka 'Term' kya hai?

Complete! 🎉

Activation function Complete!

Aliens Wiki · HIEN · Cinematic Knowledge

✅