I’m seeing this plus icon in the editor when beginning to edit a page on a completely fresh install and switching to the Starter or Blank stacks
If I switch to Integrity and disable the widget area, then switch back, the plus icon does not show anymore.