Bricks, Masonry, Asphalt and Concrete - brick on front steps falling off.

We have a concrete path leading up to our front door. The path has a few steps in it. On the face of each step there is a row of bricks - standing on end.

Over the years a crack has formed on one of the steps between the concrete and the bricks. I've recently noticed that the bricks are becoming loose and will eventually come off.

I'd like to remove the bricks, before someone gets hurt, and then reapply them myself. The project itself seems simple, but I have had no masonry experience. I do have some new bricks left over from when the house was built. Can I use these with mortar to make a fresh start?

How should I proceed?

You can use new bricks or reuse the ones you have. Using new ones will save the labor of cleaning up the old ones.

For helpful info:

http://www.hgtv.com/HGTV/project/0,1158,BDRE_project_10895,00.html