FIFA President Sepp Blatter has denied it is FIFA's responsibility to ensure the welfare of World Cup construction workers' in Qatar.