yeah honestly, make sure it's not dislocated right now, because most of the "broken noses" that i have seen were actually the dislocation of the cartilage
(if you've ever seen a true human skull, you have very little bone for your nose, basically everything you can see is cartilage, and if you leave that there, it will connect back to the stub bone where it was attached in the first place and it will/can leave a giant bump... a lot of people who have dislocated cartilage just think it's swelling, and it is to a certain extent, but is way worse if it's dislocated)
my 100% opinion is that you should get it checked out, because you could have sinus damage that you don't know about also.