You can definitely work up to it! You can always start by doing the pushup on your knees, and as you build strength, you can slowly progress up to off your knees.
If pushups on your knees is still hard, you can do half pushups on your knees (lower yourself halfway, then back up).