President Joe Biden looked back at his time in the Oval Office as a period of "hope, progress, and possibility," he said.