# Stochastic Approximation

## Table of Contents

## Overview

A simple goal: Find the solution to

## Basic algorithm

The stepsize satisfies:

- Ensure we can reach anywhere:
- To attenuate noise:

Usually will take , which satisfies both of these.

Which we can write as:

Which can be interpreted as a noisy Euler approximation to the ODE: