Philippine official said ‘mere visit’ to the country does not support claims the men underwent ‘terrorist training’.