OpenTTD Source 20241224-master-gf74b0cf984
string_func.h File Reference

Functions related to low-level strings. More...

#include <iosfwd>
#include "core/bitmath_func.hpp"
#include "string_type.h"

Go to the source code of this file.

Data Structures

struct  CaseInsensitiveComparator
 Case insensitive comparator for strings, for example for use in std::map. More...
 

Functions

void strecpy (std::span< char > dst, std::string_view src)
 Copies characters from one buffer to another.
 
std::string FormatArrayAsHex (std::span< const uint8_t > data)
 Format a byte array into a continuous hex string.
 
void StrMakeValidInPlace (char *str, const char *last, StringValidationSettings settings=SVS_REPLACE_WITH_QUESTION_MARK) NOACCESS(2)
 Scans the string for invalid characters and replaces then with a question mark '?' (if not ignored).
 
std::string StrMakeValid (std::string_view str, StringValidationSettings settings=SVS_REPLACE_WITH_QUESTION_MARK)
 Copies the valid (UTF-8) characters from str to the returned string.
 
void StrMakeValidInPlace (char *str, StringValidationSettings settings=SVS_REPLACE_WITH_QUESTION_MARK)
 Scans the string for invalid characters and replaces then with a question mark '?' (if not ignored).
 
bool strtolower (std::string &str, std::string::size_type offs=0)
 
bool StrValid (std::span< const char > str)
 Checks whether the given string is valid, i.e.
 
void StrTrimInPlace (std::string &str)
 Trim the spaces from given string in place, i.e.
 
std::string_view StrTrimView (std::string_view str)
 
bool StrStartsWithIgnoreCase (std::string_view str, const std::string_view prefix)
 Check whether the given string starts with the given prefix, ignoring case.
 
bool StrEndsWithIgnoreCase (std::string_view str, const std::string_view suffix)
 Check whether the given string ends with the given suffix, ignoring case.
 
int StrCompareIgnoreCase (const std::string_view str1, const std::string_view str2)
 Compares two string( view)s, while ignoring the case of the characters.
 
bool StrEqualsIgnoreCase (const std::string_view str1, const std::string_view str2)
 Compares two string( view)s for equality, while ignoring the case of the characters.
 
int StrNaturalCompare (std::string_view s1, std::string_view s2, bool ignore_garbage_at_front=false)
 Compares two strings using case insensitive natural sort.
 
bool StrNaturalContains (const std::string_view str, const std::string_view value)
 Checks if a string is contained in another string with a locale-aware comparison that is case sensitive.
 
bool StrNaturalContainsIgnoreCase (const std::string_view str, const std::string_view value)
 Checks if a string is contained in another string with a locale-aware comparison that is case insensitive.
 
bool ConvertHexToBytes (std::string_view hex, std::span< uint8_t > bytes)
 Convert a hex-string to a byte-array, while validating it was actually hex.
 
bool StrEmpty (const char *s)
 Check if a string buffer is empty.
 
size_t ttd_strnlen (const char *str, size_t maxlen)
 Get the length of a string, within a limited buffer.
 
bool IsValidChar (char32_t key, CharSetFilter afilter)
 Only allow certain keys.
 
size_t Utf8Decode (char32_t *c, const char *s)
 Decode and consume the next UTF-8 encoded character.
 
size_t Utf8Encode (char *buf, char32_t c)
 
size_t Utf8Encode (std::ostreambuf_iterator< char > &buf, char32_t c)
 
size_t Utf8Encode (std::back_insert_iterator< std::string > &buf, char32_t c)
 
size_t Utf8TrimString (char *s, size_t maxlen)
 Properly terminate an UTF8 string to some maximum length.
 
char32_t Utf8Consume (const char **s)
 
template<class Titr >
char32_t Utf8Consume (Titr &s)
 
int8_t Utf8CharLen (char32_t c)
 Return the length of a UTF-8 encoded character.
 
int8_t Utf8EncodedCharLen (char c)
 Return the length of an UTF-8 encoded value based on a single char.
 
bool IsUtf8Part (char c)
 
char * Utf8PrevChar (char *s)
 Retrieve the previous UNICODE character in an UTF-8 encoded string.
 
const char * Utf8PrevChar (const char *s)
 
size_t Utf8StringLength (const char *s)
 Get the length of an UTF-8 encoded string in number of characters and thus not the number of bytes that the encoded string contains.
 
size_t Utf8StringLength (const std::string &str)
 Get the length of an UTF-8 encoded string in number of characters and thus not the number of bytes that the encoded string contains.
 
bool Utf16IsLeadSurrogate (uint c)
 Is the given character a lead surrogate code point?
 
bool Utf16IsTrailSurrogate (uint c)
 Is the given character a lead surrogate code point?
 
char32_t Utf16DecodeSurrogate (uint lead, uint trail)
 Convert an UTF-16 surrogate pair to the corresponding Unicode character.
 
char32_t Utf16DecodeChar (const uint16_t *c)
 Decode an UTF-16 character.
 
bool IsTextDirectionChar (char32_t c)
 Is the given character a text direction character.
 
bool IsPrintable (char32_t c)
 
bool IsWhitespace (char32_t c)
 Check whether UNICODE character is whitespace or not, i.e.
 

Detailed Description

Functions related to low-level strings.

Definition in file string_func.h.

Function Documentation

◆ ConvertHexToBytes()

bool ConvertHexToBytes ( std::string_view  hex,
std::span< uint8_t >  bytes 
)

Convert a hex-string to a byte-array, while validating it was actually hex.

Parameters
hexThe hex-string to convert.
bytesThe byte-array to write the result to.
Note
The length of the hex-string has to be exactly twice that of the length of the byte-array, otherwise conversion will fail.
Returns
True iff the hex-string was valid and the conversion succeeded.

Definition at line 734 of file string.cpp.

References ConvertHexNibbleToByte().

Referenced by X25519AuthorizedKeyClientHandler::GetValidSecretKeyAndUpdatePublicKey(), GRFLoadConfig(), PickerLoadConfig(), and ValidateSignature().

◆ FormatArrayAsHex()

◆ IsPrintable()

bool IsPrintable ( char32_t  c)
inline

Definition at line 234 of file string_func.h.

◆ IsTextDirectionChar()

bool IsTextDirectionChar ( char32_t  c)
inline

Is the given character a text direction character.

Parameters
cThe character to test.
Returns
true iff the character is used to influence the text direction.

Definition at line 217 of file string_func.h.

References CHAR_TD_LRE, CHAR_TD_LRM, CHAR_TD_LRO, CHAR_TD_PDF, CHAR_TD_RLE, CHAR_TD_RLM, and CHAR_TD_RLO.

Referenced by MissingGlyphSearcher::FindMissingGlyphs(), GetLayouter(), and FallbackParagraphLayout::NextLine().

◆ IsUtf8Part()

bool IsUtf8Part ( char  c)
inline

Definition at line 137 of file string_func.h.

◆ IsValidChar()

bool IsValidChar ( char32_t  key,
CharSetFilter  afilter 
)

Only allow certain keys.

You can define the filter to be used. This makes sure no invalid keys can get into an editbox, like BELL.

Parameters
keycharacter to be checked
afilterthe filter to use
Returns
true or false depending if the character is printable/valid or not

Definition at line 396 of file string.cpp.

References CS_ALPHA, CS_ALPHANUMERAL, CS_HEXADECIMAL, CS_NUMERAL, CS_NUMERAL_SIGNED, and CS_NUMERAL_SPACE.

Referenced by IConsoleCmdExec(), Textbuf::InsertString(), OskWindow::OnClick(), VideoDriver_SDL_Base::PollEvent(), TranslateTTDPatchCodes(), and OskWindow::UpdateOskState().

◆ IsWhitespace()

bool IsWhitespace ( char32_t  c)
inline

Check whether UNICODE character is whitespace or not, i.e.

whether this is a potential line-break character.

Parameters
cUNICODE character to check
Returns
a boolean value whether 'c' is a whitespace character or not
See also
http://www.fileformat.info/info/unicode/category/Zs/list.htm

Definition at line 249 of file string_func.h.

Referenced by IConsoleHistoryAdd(), IcuStringIterator::Next(), FallbackParagraphLayout::NextLine(), IcuStringIterator::Prev(), and StringFilter::SetFilterTerm().

◆ StrCompareIgnoreCase()

int StrCompareIgnoreCase ( const std::string_view  str1,
const std::string_view  str2 
)

Compares two string( view)s, while ignoring the case of the characters.

Parameters
str1The first string.
str2The second string.
Returns
Less than zero if str1 < str2, zero if str1 == str2, greater than zero if str1 > str2. All ignoring the case of the characters.

Definition at line 334 of file string.cpp.

Referenced by GRFFileScanner::AddFile(), MatchesExtension(), StrEqualsIgnoreCase(), and StrNaturalCompare().

◆ strecpy()

void strecpy ( std::span< char >  dst,
std::string_view  src 
)

Copies characters from one buffer to another.

Copies the source string to the destination buffer with respect of the terminating null-character and the size of the destination buffer.

Note
usage: strecpy(dst, src);
Parameters
dstThe destination buffer
srcThe buffer containing the string to copy

Definition at line 60 of file string.cpp.

References Debug.

Referenced by FileStringReader::HandlePragma(), and StringReader::ParseFile().

◆ StrEmpty()

bool StrEmpty ( const char *  s)
inline

Check if a string buffer is empty.

Parameters
sThe pointer to the first element of the buffer
Returns
true if the buffer starts with the terminating null-character or if the given pointer points to nullptr else return false

Definition at line 57 of file string_func.h.

Referenced by GetEnv(), GRFConfig::GetName(), IConsoleCmdExec(), IConsoleHistoryAdd(), SavePresetWindow::OnClick(), NewGRFWindow::OnInvalidateData(), openttd_main(), FileStringReader::ParseFile(), RenameSign(), and MusicDriver_ExtMidi::Start().

◆ StrEndsWithIgnoreCase()

bool StrEndsWithIgnoreCase ( std::string_view  str,
const std::string_view  suffix 
)

Check whether the given string ends with the given suffix, ignoring case.

Parameters
strThe string to look at.
suffixThe suffix to look for.
Returns
True iff the end of the string is the same as the suffix, ignoring case.

Definition at line 321 of file string.cpp.

References StrEqualsIgnoreCase().

Referenced by TextfileWindow::AfterLoadText(), and TextfileWindow::NavigateToFile().

◆ StrEqualsIgnoreCase()

bool StrEqualsIgnoreCase ( const std::string_view  str1,
const std::string_view  str2 
)

◆ StrMakeValid()

std::string StrMakeValid ( std::string_view  str,
StringValidationSettings  settings 
)

Copies the valid (UTF-8) characters from str to the returned string.

Depending on the settings invalid characters can be replaced with a question mark, as well as determining what characters are deemed invalid.

Parameters
strThe string to validate.
settingsThe settings for the string validation.

Definition at line 205 of file string.cpp.

References settings, and StrMakeValid().

◆ StrMakeValidInPlace() [1/2]

void StrMakeValidInPlace ( char *  str,
const char *  last,
StringValidationSettings  settings 
)

Scans the string for invalid characters and replaces then with a question mark '?' (if not ignored).

Parameters
strThe string to validate.
lastThe last valid character of str.
settingsThe settings for the string validation.

Definition at line 178 of file string.cpp.

References settings, and StrMakeValid().

Referenced by Textbuf::Assign(), and StrMakeValidInPlace().

◆ StrMakeValidInPlace() [2/2]

void StrMakeValidInPlace ( char *  str,
StringValidationSettings  settings 
)

Scans the string for invalid characters and replaces then with a question mark '?' (if not ignored).

Only use this function when you are sure the string ends with a '\0'; otherwise use StrMakeValidInPlace(str, last, settings) variant.

Parameters
strThe string (of which you are sure ends with '\0') to validate.

Definition at line 192 of file string.cpp.

References settings, and StrMakeValidInPlace().

◆ StrNaturalCompare()

int StrNaturalCompare ( std::string_view  s1,
std::string_view  s2,
bool  ignore_garbage_at_front 
)

Compares two strings using case insensitive natural sort.

Parameters
s1First string to compare.
s2Second string to compare.
ignore_garbage_at_frontSkip punctuation characters in the front
Returns
Less than zero if s1 < s2, zero if s1 == s2, greater than zero if s1 > s2.

Definition at line 589 of file string.cpp.

References _current_collator, MacOSStringCompare(), SkipGarbage(), and StrCompareIgnoreCase().

Referenced by BuildGuiGroupList(), CargoSpecNameSorter(), EngineNameSorter(), GRFSorter(), IndustryDirectoryWindow::IndustryNameSorter(), IndustryTypeNameSorter(), NetworkContentListWindow::NameSorter(), NewGRFWindow::NameSorter(), DropDownString< TBase, TFs, TEnd >::NatSortFunc(), NetworkGameWindow::NGameNameSorter(), FiosItem::operator<(), SignList::SignNameSorter(), CompanyStationsWindow::StationNameSorter(), TownDirectoryWindow::TownNameSorter(), NetworkContentListWindow::TypeSorter(), and VehicleNameSorter().

◆ StrNaturalContains()

bool StrNaturalContains ( const std::string_view  str,
const std::string_view  value 
)

Checks if a string is contained in another string with a locale-aware comparison that is case sensitive.

Parameters
strThe string to search in.
valueThe string to search for.
Returns
True if a match was found.

Definition at line 660 of file string.cpp.

References ICUStringContains(), MacOSStringContains(), and Win32StringContains().

Referenced by StringFilter::AddLine().

◆ StrNaturalContainsIgnoreCase()

bool StrNaturalContainsIgnoreCase ( const std::string_view  str,
const std::string_view  value 
)

Checks if a string is contained in another string with a locale-aware comparison that is case insensitive.

Parameters
strThe string to search in.
valueThe string to search for.
Returns
True if a match was found.

Definition at line 687 of file string.cpp.

References ICUStringContains(), MacOSStringContains(), and Win32StringContains().

Referenced by StringFilter::AddLine().

◆ StrStartsWithIgnoreCase()

bool StrStartsWithIgnoreCase ( std::string_view  str,
const std::string_view  prefix 
)

Check whether the given string starts with the given prefix, ignoring case.

Parameters
strThe string to look at.
prefixThe prefix to look for.
Returns
True iff the begin of the string is the same as the prefix, ignoring case.

Definition at line 281 of file string.cpp.

References StrEqualsIgnoreCase().

◆ strtolower()

bool strtolower ( std::string &  str,
std::string::size_type  offs = 0 
)

Definition at line 378 of file string.cpp.

◆ StrTrimInPlace()

void StrTrimInPlace ( std::string &  str)

Trim the spaces from given string in place, i.e.

the string buffer that is passed will be modified whenever spaces exist in the given string. When there are spaces at the begin, the whole string is moved forward and when there are spaces at the back the '\0' termination is moved.

Parameters
strThe string to perform the in place trimming on.

Definition at line 260 of file string.cpp.

Referenced by TarScanner::AddFile(), CheckClientAndServerName(), NetworkValidateClientName(), and NetworkValidateServerName().

◆ StrTrimView()

std::string_view StrTrimView ( std::string_view  str)

Definition at line 265 of file string.cpp.

◆ StrValid()

bool StrValid ( std::span< const char >  str)

Checks whether the given string is valid, i.e.

contains only valid (printable) characters and is properly terminated.

Note
std::span is used instead of std::string_view as we are validating fixed-length string buffers, and std::string_view's constructor will assume a C-string that ends with a NUL terminator, which is one of the things we are checking.
Parameters
strSpan of chars to validate.

Definition at line 227 of file string.cpp.

References Utf8Decode(), and Utf8EncodedCharLen().

Referenced by LanguagePackHeader::IsValid().

◆ ttd_strnlen()

size_t ttd_strnlen ( const char *  str,
size_t  maxlen 
)
inline

Get the length of a string, within a limited buffer.

Parameters
strThe pointer to the first element of the buffer
maxlenThe maximum size of the buffer
Returns
The length of the string

Definition at line 69 of file string_func.h.

◆ Utf16DecodeChar()

char32_t Utf16DecodeChar ( const uint16_t *  c)
inline

Decode an UTF-16 character.

Parameters
cPointer to one or two UTF-16 code points.
Returns
Decoded Unicode character.

Definition at line 202 of file string_func.h.

References Utf16DecodeSurrogate(), and Utf16IsLeadSurrogate().

Referenced by IcuStringIterator::Next(), and IcuStringIterator::Prev().

◆ Utf16DecodeSurrogate()

char32_t Utf16DecodeSurrogate ( uint  lead,
uint  trail 
)
inline

Convert an UTF-16 surrogate pair to the corresponding Unicode character.

Parameters
leadLead surrogate code point.
trailTrail surrogate code point.
Returns
Decoded Unicode character.

Definition at line 192 of file string_func.h.

Referenced by HandleCharMsg(), and Utf16DecodeChar().

◆ Utf16IsLeadSurrogate()

bool Utf16IsLeadSurrogate ( uint  c)
inline

Is the given character a lead surrogate code point?

Parameters
cThe character to test.
Returns
True if the character is a lead surrogate code point.

Definition at line 171 of file string_func.h.

Referenced by HandleCharMsg(), HandleIMEComposition(), and Utf16DecodeChar().

◆ Utf16IsTrailSurrogate()

bool Utf16IsTrailSurrogate ( uint  c)
inline

Is the given character a lead surrogate code point?

Parameters
cThe character to test.
Returns
True if the character is a lead surrogate code point.

Definition at line 181 of file string_func.h.

Referenced by HandleCharMsg().

◆ Utf8CharLen()

int8_t Utf8CharLen ( char32_t  c)
inline

Return the length of a UTF-8 encoded character.

Parameters
cUnicode character.
Returns
Length of UTF-8 encoding for character.

Definition at line 105 of file string_func.h.

Referenced by Textbuf::InsertChar(), Textbuf::InsertString(), and Textbuf::UpdateSize().

◆ Utf8Consume() [1/2]

char32_t Utf8Consume ( const char **  s)
inline

Definition at line 85 of file string_func.h.

◆ Utf8Consume() [2/2]

template<class Titr >
char32_t Utf8Consume ( Titr &  s)
inline

Definition at line 93 of file string_func.h.

◆ Utf8Decode()

size_t Utf8Decode ( char32_t *  c,
const char *  s 
)

Decode and consume the next UTF-8 encoded character.

Parameters
cBuffer to place decoded character.
sCharacter stream to retrieve character from.
Returns
Number of characters in the sequence.

Definition at line 419 of file string.cpp.

References GB(), and HasBit().

Referenced by Textbuf::DeleteChar(), FixSCCEncoded(), FormatString(), GlobalVarChangeInfo(), VideoDriver_SDL_Base::PollEvent(), StringFilter::SetFilterTerm(), SkipGarbage(), StrMakeValid(), StrValid(), and TranslateTTDPatchCodes().

◆ Utf8Encode() [1/3]

size_t Utf8Encode ( char *  buf,
char32_t  c 
)

Definition at line 486 of file string.cpp.

◆ Utf8Encode() [2/3]

size_t Utf8Encode ( std::back_insert_iterator< std::string > &  buf,
char32_t  c 
)

Definition at line 496 of file string.cpp.

◆ Utf8Encode() [3/3]

size_t Utf8Encode ( std::ostreambuf_iterator< char > &  buf,
char32_t  c 
)

Definition at line 491 of file string.cpp.

◆ Utf8EncodedCharLen()

int8_t Utf8EncodedCharLen ( char  c)
inline

Return the length of an UTF-8 encoded value based on a single char.

This char should be the first byte of the UTF-8 encoding. If not, or encoding is invalid, return value is 0

Parameters
cchar to query length of
Returns
requested size

Definition at line 124 of file string_func.h.

References GB().

Referenced by FixSCCEncoded(), StrMakeValid(), StrValid(), TranslateTTDPatchCodes(), and Utf8TrimString().

◆ Utf8PrevChar() [1/2]

char * Utf8PrevChar ( char *  s)
inline

Retrieve the previous UNICODE character in an UTF-8 encoded string.

Parameters
schar pointer pointing to (the first char of) the next character
Returns
a pointer in 's' to the previous UNICODE character's first byte
Note
The function should not be used to determine the length of the previous encoded char because it might be an invalid/corrupt start-sequence

Definition at line 149 of file string_func.h.

Referenced by Textbuf::Assign(), and Textbuf::DeleteChar().

◆ Utf8PrevChar() [2/2]

const char * Utf8PrevChar ( const char *  s)
inline

Definition at line 156 of file string_func.h.

◆ Utf8StringLength() [1/2]

size_t Utf8StringLength ( const char *  s)

Get the length of an UTF-8 encoded string in number of characters and thus not the number of bytes that the encoded string contains.

Parameters
sThe string to get the length for.
Returns
The length of the string in characters.

Definition at line 359 of file string.cpp.

Referenced by Textbuf::Assign(), CmdAlterGroup(), CmdFoundTown(), CmdPlaceSign(), CmdRenameCompany(), CmdRenameDepot(), CmdRenameEngine(), CmdRenamePresident(), CmdRenameSign(), CmdRenameStation(), CmdRenameTown(), CmdRenameVehicle(), CmdRenameWaypoint(), GenerateCompanyName(), GeneratePresidentName(), Utf8StringLength(), and VerifyTownName().

◆ Utf8StringLength() [2/2]

size_t Utf8StringLength ( const std::string &  str)

Get the length of an UTF-8 encoded string in number of characters and thus not the number of bytes that the encoded string contains.

Parameters
sThe string to get the length for.
Returns
The length of the string in characters.

Definition at line 373 of file string.cpp.

References Utf8StringLength().

◆ Utf8TrimString()

size_t Utf8TrimString ( char *  s,
size_t  maxlen 
)

Properly terminate an UTF8 string to some maximum length.

Parameters
sstring to check if it needs additional trimming
maxlenthe maximum length the buffer can have.
Returns
the new length in bytes of the string (eg. strlen(new_string))
Note
maxlen is the string length INCLUDING the terminating '\0'

Definition at line 508 of file string.cpp.

References Utf8EncodedCharLen().