Yes, you can use seeds from a pepper you bought at the supermarket to try growing new pepper plants.
Keep in mind that seeds from supermarket peppers may not always have the same characteristics as the original plant because supermarket peppers are often hybrid varieties. Nonetheless, it's a fun and cost-effective way to try growing your own peppers and see what variations emerge.