Yes, there are a number of reasons why delaying the introduction for too long can be potentially disadvantageous.
Apart from the obvious ones of sugar and salt, there are a number of other food products you should avoid in the first year of life.  These include:
This is the number-one fear for all parents when starting babies on solids. The truth is, choking is not as common as you may think, especially if you take precautions to prevent it . What is more common is gagging.  It can be no less frightening for parents, however, it is important to know what the difference is and a plan of action if required. 
Signs of gagging include:
Gagging is normal. In young infants the gag reflex is very prominent. This natural automatic response is actually a protection mechanism to prevent choking. This strong tongue-thrust reflex, when food stimulates the back of the mouth, is why you should wait until at least 4 to 5 months before introducing solids. Even still, this can make those early feeding sessions quite difficult (and messy!) until he gets used to moving food to the back of the throat. As he gets older, this sensitivity in the back of the mouth will slowly diminish and he will be able to manage larger and more complex texture more independently.
It is important we don’t intervene when he is gagging as this can actually interrupt his ability to cough/gag food back up and may even cause food to dislodge further down into his airway. Rather, offer praise and support and don’t show any anxiety or fear. Remember, we want to foster a good relationship with food and mealtimes. Showing our own anxieties unnecessarily can be detrimental in overly sensitive children.
Signs of choking include:
Choking, on the other hand, is a lot more serious and it is important we all know what to do if it does happen, before it happens. Choking happens when something is stuck in the back of the throat and he is unable to cough/gag it back out. As it can obstruct the airway and stop the ability to breath, it can be life threatening. It is therefore strongly recommended that caregivers are skilled in knowing what to do in the unlikely event of a choking episode. 
There are many foods that can stimulate an allergic response. The most common are:
Although it can feel daunting to introduce potentially allergenic foods, research now shows us that leaving it for too long can actually exacerbate the problem. Evidence affirms that the early introduction of potential allergens, even in high-risk infants, can actually help protect against the development of an allergy . In light of this, most guidelines around the world advise to introduce all potential allergens in the first year of life, but not before 4 months. [34, 36, 37, 55, 77]
However, if someone in your baby’s immediate family (mother, father, sibling) is known to have a severe allergy to any of the food groups, please consult with your pediatrician first.
The American Academy of Pediatrics (AAP) New Guidelines for Infant Food Allergy Prevention
What Families Need to Know
How to Introduce Allergenic Foods
Rub a small amount of smooth peanut butter (a good-quality peanut butter without added salt or sugar) on the inside of the infant’s lip (not on their skin).
Repeat the steps above but with well-cooked egg. You can mix a small amount (1⁄4 teaspoon) of mashed hard-boiled egg with a liquid such as breast milk or formula, or into the baby’s usual food (such as vegetable puree). There is no need to separate the white and yolk.
In general, if there is going to be an allergic reaction to a certain food, it will most likely occur when he is eating, or shortly after. Very occasionally it doesn’t show up for several hours so it is important to keep a close eye on him for potential signs, especially when introducing the common allergens. It is always a good idea to have a chat with your health professional before you introduce the most common allergens (peanuts, egg, fish, dairy). They may advise to have some medication on hand in case it is required.
Signs of a mild to moderate allergic reaction
Signs of severe allergic reaction (anaphylaxis)
Yes. Allergic reactions do not always occur on the first exposure to the new food. Monitor him if it is a common allergen (e.g. peanuts, egg, dairy) for at least 6 exposures. Once introduced, it is a good idea to keep exposing him to that food on a regular basis (once a week is good) as this helps to build up his immune system to that particular food.
A food allergy stimulates an immune response and can result in these symptoms  within 2 hours of exposure. A food intolerance, on the other hand , results in a range of mainly digestive symptoms, including abdominal bloating, wind, diarrhea, nausea, and indigestion. However, a food intolerance can also result in eczema flare-ups and/or asthma. Sometimes these symptoms can mimic other medical conditions and it’s advised you follow up with your pediatrician.
Generally, by 5 to 6 months reflux starts to improve as the gastrointestinal tract starts to mature. Sometimes, starting him on solids can actually help with reflux. However, to start off with you might want to avoid highly acidic foods such as citrus and tomato. Here are some more tips for a baby prone to reflux:
All FAQ [numbers] relate to our references and sources, click here to view.
Disclaimer: The information provided is the opinion of Good Feeding, it has not been evaluated by healthcare professionals, and is for educational purposes only. Before starting any new foods or feeding practices, please consult your baby's healthcare professional.