Peering into the formation history of Beta Pic b with long-baseline interferometry