It doesn't work for everything, but many banks will have a website you can use just fine from the phone's browser. If you're trying to do full payments with the phone that won't work of course, but if you get a physical credit card/debit card you can (usually) do everything else with the mobile site. This is what I do for my Graphene OS phone