Will collecting all Raft Notes and Blueprints affect story progression?

Yes. Notes contain story clues and next coordinates, including critical lore inside the Mayor’s Chest that directs you to the next story island.