Can someone find your house using just your IP address? The short answer is no, but they can get surprisingly close.
Companies like MaxMind or IPinfo maintain massive databases. They link IP ranges to specific Internet Service Providers (ISPs) and their physical data centers.
An IP address does not contain your name, street number, or apartment. To get that information, someone would need a court order (subpoena) to force your ISP to reveal who was using that IP at a specific time.