The White House said Biden is heading to Delaware and will "continue to carry out all of his duties fully during that time."