Don't worry about it Clem, it happens to all of us for a variety of reasons, I looked at it after arriving in Sydney in '95 (missed the GF that year too - spewin'). After having footy on tap whilst living in Victoria, it was like being put on one of those anti-smoking patches, you know there's footy around but just can't see it. Went to a few Swans games and it was so empty that I was able to yell across the ground to the hot-dog seller to come over so I could buy one. By the last few rounds of '96, the chardonnay bandwagoners had filled the place to gunnels seeing as it was now obvious that the Swans were headed to the finals and ultimately a GF berth.
The thing is, if you want an AFL fix (and really, who doesn't ?) then the Swans are the only show in town. The only other option is to venture down to Canberra to watch some Kangas games. Either way, you are getting to watch live AFL but it's not the team that you follow.
I found in the first season that I was able to get mildly excited watching the Swans games, I even knew the players names and the words to their club song (man o man, do they flog that one to death after a game

). There were plenty of Swans fans who were ex-Melbourne, ex-Perth, ex-Adelaide etc who adopted the local team as theirs and openly encouraged me to do the same. It sort of seemed like the thing to do, when in Rome - you know the story.
However, the ultimate litmus came for me the next year when the Blues arrived in Sydney to play at the SCG. When the team ran onto the field and the strains of 'da de da de da' came through the PA system, I stood up and sang 'Lily Of Laguna' as goddam loud and as passionately as was humanly possible, I just couldn't help myself. It was at that point that I knew I'd never buy another Swans membership again nor consider barracking for them. It just didn't feel right plus there was far too many emotions & passions going through my body during the game. Even though we got pole-axed that game and it hurt me badly, I was rapt to see the famous white CFC logo running around in front of me again. Stick the Swans up your jaxxy, I am a died-in-the-wool Bluesman and always will be.
Look, the couple of years that I attended Swans games regularly gave me great pleasure, especially watching Plugger break the goal-kicking record, that was a real hoot. Marvelling at Paul Kelly was nearly worth the price of admission alone.
However, when it all came down to it, I got over not seeing footy live every week like the old days. It was a new city and things were always going to be different. The novelty wore off and I only go to AFL games occassionally now, unless the Blueboys are in town of course.
So don't feel bad because you bought a Swans membership Clem, sometimes it makes economic sense to do so (cheaper per game admission price that way0. As long as you know where your loyalty lies, you are entitled to watch some games live, even if it is the only bloody one available !!