Chosen Solution
Apple logo then restart after change the battery
If you still have the original battery try that one out and see if it boots up up properly. It might just be a battery problem if you can boot up on your original battery.
Make sure the battery is snapped in properly, i had the same problem on my old IPhone 5. And also make sure you put the shield and the screws back on.
