Kinetic theory for classical and quantum many-body chaos