It sounds like that line may have been connected to your demarcation point for your house and by pulling on it too hard it may have dislodged the other connections to it.
Call your phone company, or another telecomm professional to come fix it. Expect a repair bill.
Call your phone company, or another telecomm professional to come fix it. Expect a repair bill.