Ceremony only?

Hi everyone! I am new here and only newly engaged too.

Before getting engaged my fiancée and I were set on eloping. Neither of us want a big wedding, and both sides of our families are quite messy (recent divorces with a lot of drama, a lot of family falling outs, not close families etc). However, now that we’re engaged I can’t help but feel slightly guilty about eloping. I know it will cause more drama in the family, and whilst I know that it’s ultimately our day and our choice.. I’m starting to question whether eloping is right or not (although my OH still wants to).

The other piece which has me second guessing elopement is that I’d love to get married in a church. But, I would feel too guilty to have just OH, me and two witnesses in a big church when our closest family could’ve attended!
So, I’ve been thinking about an option which may work (providing it isn’t rude - which I’d love your opinion on!) That idea is getting married in a church where we would invite all of our CLOSEST family (so we’re still talking a small ceremony, maybe 10/15 guests if they all come) but explain to our family that we will not be having a reception. We would marry, have photographs outside and then OH and I would leave for a romantic weekend away together.
Considering the alternative is not inviting anyone.. would this be OK?
All guests would be local apart from my Dad who I do not have a close relationship with at all, and I question if he would attend anyway (reception or no reception).
Please share your thoughts. I know it isn’t the norm but it’s the only solution I can think of.