"for their teacher's birthday" modifies "party", a noun, telling what they will hold. It's an adjective phrase.
#1 also makes no sense. Which party? The one yesterday or the one tomorrow or the one today? The one at your house or the one at the local nightclub or the one in the street? Which one? The question should be WHY will they hold a party, as in #3.
1. Which party will they hold?
2. They will hold a party for their teacher's birthday.
[#2 is the answer to #1. 'For their teacher's birthday' is an adjective phrase, which modifies 'party.']
3. Why will they hold a party?
4. They will hold a party for their teacher's birthday.
[#4 is the answer to #3. 'For their teacher's birthday' is an adverb phrase, which modifies 'hold.' Is my explanation right? Then, #2 or #4 has ambiguity. Is that right?]
3 answers
Thank you, Reed. Then, 'for their teacher's birthday' should be an adverb phrase, which modifies 'held'? Is that right? [In #4]
You did not read what I wrote. "for their teacher's birthday" tells what kind of party they will hold. Party is a noun. It's an adjective phrase. It does not modify "hold". They will hold for their teacher's birthday? What will they hold? Her hand, a balloon, their breath? They will hold A PARTY! The prepositional phrase tells why they will have or hold A PARTY. Why a party? Is it for his birthday, a going-away party, for his anniversary, because he's a nice guy or a good teacher? It's "for his birthday." It modifies PARTY.