Man page or keyword search:   man All Sections 1 - General Commands 2 - System Calls 3 - Subroutines, Functions 4 - Special Files 5 - File Formats 6 - Games and Screensavers 7 - Macros and Conventions 8 - Maintenence Commands 9 - Kernel Interface New Commands Server 4.4BSD AIX Alpinelinux Archlinux Aros BSDOS BSDi Bifrost CentOS Cygwin Darwin Debian DigitalUNIX DragonFly ElementaryOS Fedora FreeBSD Gentoo GhostBSD HP-UX Haiku Hurd IRIX Inferno JazzOS Kali Knoppix LinuxMint MacOSX Mageia Mandriva Manjaro Minix MirBSD NeXTSTEP NetBSD OPENSTEP OSF1 OpenBSD OpenDarwin OpenIndiana OpenMandriva OpenServer OpenSuSE OpenVMS Oracle PC-BSD Peanut Pidora Plan9 QNX Raspbian RedHat Scientific Slackware SmartOS Solaris SuSE SunOS Syllable Tru64 UNIXv7 Ubuntu Ultrix UnixWare Xenix YellowDog aLinux   44335 pages apropos Keyword Search (all sections) Output format html ascii pdf view pdf save postscript

XTOKID(1)			 User Commands			     XTOKID(1)

NAME
       xtokid - Print all tokens found in a source file.

SYNOPSIS
       xtokid [OPTION]... [FILE]...

DESCRIPTION
       Print all tokens found in a source file.

       -i, --include=LANGS
	      include languages in LANGS (default: "C C++ asm")

       -x, --exclude=LANGS
	      exclude languages in LANGS

       -l,  --lang-option=L:OPT	 pass  OPT  as	a  default for language L (see
	      below)

       -m, --lang-map=MAPFILE
	      use MAPFILE to map file names onto source language

       -d, --default-lang=LANG
	      make LANG the default source language

       -p, --prune=NAMES
	      exclude the named files and/or directories

       --files0-from=F
	      tokenize only the files specified	 by  NUL-terminated  names  in
	      file F

       --help display  this  help  and exit --version		output version
	      information and exit

       The following arguments apply to the language-specific scanners:

   C language:
       -k,--keep=CHARS
	      Allow CHARS in single-token strings, keep the result

       -i,--ignore=CHARS
	      Allow CHARS in single-token strings, toss the result

       -u,--strip-underscore
	      Strip a leading underscore from single-token strings

   C++ language:
       -k,--keep=CHARS
	      Allow CHARS in single-token strings, keep the result

       -i,--ignore=CHARS
	      Allow CHARS in single-token strings, toss the result

       -u,--strip-underscore
	      Strip a leading underscore from single-token strings

   Java language:
       -k,--keep=CHARS
	      Allow CHARS in single-token strings, keep the result

       -i,--ignore=CHARS
	      Allow CHARS in single-token strings, toss the result

       -u,--strip-underscore
	      Strip a leading underscore from single-token strings

   Assembly language:
       -c,--comment=CHARS
	      Any of CHARS starts a comment until end-of-line

       -k,--keep=CHARS
	      Allow CHARS in tokens, and keep the result

       -i,--ignore=CHARS
	      Allow CHARS in tokens, and toss the result

       -u,--strip-underscore
	      Strip a leading underscore from tokens

       -n,--no-cpp
	      Don't handle C pre-processor directives

   Text language:
       -i,--include=CHAR-CLASS
	      Treat characters of CHAR-CLASS as token constituents

       -x,--exclude=CHAR-CLASS
	      Treat characters of CHAR-CLASS as token delimiters

   Perl language:
       -i,--include=CHAR-CLASS
	      Treat characters of CHAR-CLASS as token constituents

       -x,--exclude=CHAR-CLASS
	      Treat characters of CHAR-CLASS as token delimiters

       -d,--dtags
	      Include documentation tags

       Lisp language:

REPORTING BUGS
       Report bugs to bug-idutils@gnu.org

SEE ALSO
       The full documentation for xtokid is maintained as  a  Texinfo  manual.
       If  the	info  and xtokid programs are properly installed at your site,
       the command

	      info xtokid

       should give you access to the complete manual.

xtokid - 4.6			 February 2012			     XTOKID(1)

Vote for polarhome