It sounds like you didn't bother checking out your legal obligations very well, I can't see a lawyer saying it's okay to take a fathers kids interstate and he has no rights to stop you.  I think you would have a good case for hardship before a tribunal regarding breaking your lease.  The cost for this minimal ie about $50.