Adding songs to your new playlist is as simple as dragging and dropping them. Your music library will appear to the left of the playlist window. You can navigate through it to find the songs you want to add to the playlist.
When you find one of those songs, simply drag it to the playlist window on the right. Repeat this process until you've got all the songs you want added to your playlist (you can also add TV shows and podcasts to playlists).