If my new build does not appraise for the purchase price of the house, will FHA still approve the loan?

My husband and I are building a new home. We added a few upgrades that I hear may not appraise at the full value. We want to the house with all the upgrades. There is a clause allowing us to walk away if the house does not appraise but we really want the house. Will FHA still approve the loan?