[Barrelfish-users] questions about phoenix kmeans

[Peter Simon]

Hi Liyang,

These questions are probably best asked in the Phoenix MapReduce mailing list (phoenix-users at lists.stanford.edu), rather than the Barrelfish list. The Barrelfish behavior of Phoenix should be identical to the Linux one.

Hope this helps,
Simon

From: Liyang [mailto:tangliyang921 at gmail.com]
Sent: Samstag, 24. Dezember 2011 03:24
To: barrelfish-users at lists.inf.ethz.ch
Subject: [Barrelfish-users] questions about phoenix kmeans

Dear all,

I've read the kmeans code here: http://www.lingrok.org/source/xref/barrelfish/usr/phoenix_tests/kmeans.c. I wonder if you maintain the code, but I don't know who else to contact.
I do have some questions about using phoenix in kmeans.






map_reduce_args<http://www.lingrok.org/source/xref/barrelfish/usr/phoenix_tests/kmeans.c#map_reduce_args>.L1_cache_size<http://www.lingrok.org/source/s?defs=L1_cache_size&project=barrelfish> = atoi<http://www.lingrok.org/source/s?defs=atoi&project=barrelfish>(GETENV<http://www.lingrok.org/source/s?defs=GETENV&project=barrelfish>("MR_L1CACHESIZE"));//1024 * 8;

map_reduce_args<http://www.lingrok.org/source/xref/barrelfish/usr/phoenix_tests/kmeans.c#map_reduce_args>.num_map_threads<http://www.lingrok.org/source/s?defs=num_map_threads&project=barrelfish> = atoi<http://www.lingrok.org/source/s?defs=atoi&project=barrelfish>(GETENV<http://www.lingrok.org/source/s?defs=GETENV&project=barrelfish>("MR_NUMTHREADS"));//8;

map_reduce_args<http://www.lingrok.org/source/xref/barrelfish/usr/phoenix_tests/kmeans.c#map_reduce_args>.num_reduce_threads<http://www.lingrok.org/source/s?defs=num_reduce_threads&project=barrelfish> = atoi<http://www.lingrok.org/source/s?defs=atoi&project=barrelfish>(GETENV<http://www.lingrok.org/source/s?defs=GETENV&project=barrelfish>("MR_NUMTHREADS"));//16;

map_reduce_args<http://www.lingrok.org/source/xref/barrelfish/usr/phoenix_tests/kmeans.c#map_reduce_args>.num_merge_threads<http://www.lingrok.org/source/s?defs=num_merge_threads&project=barrelfish> = atoi<http://www.lingrok.org/source/s?defs=atoi&project=barrelfish>(GETENV<http://www.lingrok.org/source/s?defs=GETENV&project=barrelfish>("MR_NUMTHREADS"));//8;

map_reduce_args<http://www.lingrok.org/source/xref/barrelfish/usr/phoenix_tests/kmeans.c#map_reduce_args>.num_procs<http://www.lingrok.org/source/s?defs=num_procs&project=barrelfish> = atoi<http://www.lingrok.org/source/s?defs=atoi&project=barrelfish>(GETENV<http://www.lingrok.org/source/s?defs=GETENV&project=barrelfish>("MR_NUMPROCS"));//16;

How could the above codes get the values for args? I mean, where are those MR_ environment variables defined? And what if they are not? Does the cache size variable has any connection with the splitter function? I know that phoenix schedules threads according to cache size as chunk size, but how?

I would be much appreciated if you could help me with these questions.

Best regards,
- Liyang
-------------- next part --------------
An HTML attachment was scrubbed...
URL: https://lists.inf.ethz.ch/pipermail/barrelfish-users/attachments/20111224/5f0c8ae8/attachment.html