Hi guys,
this is day 17 out of 100 days of code in go lang.
Today I have played with files, sorting, bytes and strings. The goal was to create a kind of indexed file where all lines are arranged alphabetically.
What I got is very slow algorithm which took 15 seconds to insert 10K strings in an empty file and 49 seconds to insert another 10K strings to the same file. So, it slowdown very quickly as size grow.
func writeLineToFileSorted(newdata string) {
indexData, err := ioutil.ReadFile("db.txt")
if err != nil {
log.Fatal(err)
}
var newIndexData []string
for _, line := range bytes.Split(indexData, []byte("\n")) {
//fmt.Printf("%s\n", line)
newIndexData = append(newIndexData, string(line))
}
newIndexData = append(newIndexData, string(newdata))
sort.Strings(newIndexData)
bytesData := []byte(strings.Join(newIndexData, "\n"))
ioutil.WriteFile("db.txt", bytesData, 0644)
}
I have to convert between strings and bytes which was kind of annoying, but maybe I am doing it wrong? Please let me know in comments.
If you want to load test it here is how:
func main() {
rand.Seed(time.Now().UnixNano())
var newdata string
for i := 0; i < 10000; i++ {
newdata = randStringRunes(10)
writeLineToFileSorted(newdata)
fmt.Println(i)
}
}
var letterRunes = []rune("abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ")
func randStringRunes(n int) string {
b := make([]rune, n)
for i := range b {
b[i] = letterRunes[rand.Intn(len(letterRunes))]
}
return string(b)
}
Source code at Github
Happy coding!