Yes! I have a couple nice ideas... Not my original ideas, but ones that I've seen or heard of examples before.
1) The most impressive idea I've ever seen, was a picture frame which included a picture of the bird, name (and significant dates if you wish), and then feathers of all colors and sizes from the bird arranged into designs around the photo. For example, flowers and leaves with the flowers maybe being from various smaller feathers, etc. Play with the different colors, shapes and sizes and make any design you wish. This might take a degree of artistic ability.
2) Put feathers (if small enough) into the inside of a clear blown glass Christmas tree ornament. Make sure it doesn't break! You'd have to be very careful with displaying or storing it so it doesn't break with the thin glass.
3) A take off of #2, since I don't trust myself with the fragile glass, and I wanted a bigger container for Raven's larger feathers... I got some clear plastic display boxes (dollar store or craft store should carry these). I plan to decorate the outside of the boxes with their names and designs. Write on the outside with that 'puffy paint' you can get at a craft store, glue on with a hot glue gun any kind of 3D items such as bows, flowers made of foam or plastic or whatever, some real tiny foot toys, or any items that are particular to that bird and small enough to glue on and make the keepsake box attractive. You get the idea

.
I bought the clear plastic boxes, and have tons of feathers from everyone, but I don't have the time these days to separate them all lol. One day I'll do it.