Do I have to select Publish in both the content and Playlist or Collection pages when I edit content items in order to see changes?

No. If you publish Content in Skykit Beam, those changes will automatically take effect for Playlists or Collections that contain that content. 

If you edit the Playlist or Collection itself, such as by removing or editing content or editing Play Rules, then the Playlist or Collection must be published.