Taylor Swift carries a guitar case as she walks around New York City